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Preface 


Over the last few years, there has been a significant increase in the number of 
students studying partial differential equations at the undergraduate level, and 
many of these students have come from areas other than mathematics, where 
intuition rather than mathematical rigor is emphasized. In writing Partial Dif- 
ferential Equations for Scientists and Engineers, I have tried to stimulate intuitive 
thinking, while, at the same time, not losing too much mathematical accuracy. 
At one extreme, it is possible to approach the subject on a high mathematical 
epsilon-delta level, which generally results in many undergraduate students not 
knowing what's going on. At the other extreme, it is possible to wave away all 
the subtleties until neither the student nor the teacher knows what's going on. 
I have tried to steer the mathematical thinking somewhere between these two 
extremes. 

Partial Differential Equations for Scientists and Engineers evolved from a set 
of lecture notes I have been preparing for the last five years. It is an uncon- 
ventional text in one regard: It is organized in 47 semi-independent lessons in 
contrast to the more usual chapter-by-chapter approach. 

Separation of variables and integral transforms are the two most important 
analytic tools discussed. Several nonstandard topics, such as Monte Carlo meth- 
ods, calculus of variations, control theory, potential theory, and integral equa- 
tions, are also discussed because most students will eventually come across these 
subjects at some time in their studies. Unless they study these topics here, they 
will probably never study them formally. 

This book can be used for a one- or two-semester course at the junior or 
senior level. It assumes only a knowledge of differential and integral calculus 
and ordinary differential equations. Most lessons take either one or two days, 
so that a typical one-semester syllabus would be: Lessons 1-13, 15-17, 19-20, 
22-23, 25-277, 30-32, 37-39. All 47 lessons can easily be covered in two semesters, 
with plenty of time to work problems. 

The author wishes to thank the editors at Wiley for their invitation to write 
this book as well as the reviewers, Professor Chris Rorres and Professor M. 
Kursheed Ali, who helped me greatly with their suggestions. Any further sug- 
gestions for improvement of this book, either from students or teachers, would 
be greatly appreciated. Thanks also to Dorothy, Susan, Alexander, and Daisy 

Farlow. 


Stanley J. Farlow 


Contents 


1 INTRODUCTION / 1 
LESSON 1 Introduction to Partial Differential Equations / 3 


2 DIFFUSION-TYPE PROBLEMS / 9 


LESSON 2  Diffusion-Type Problems (Parabolic Equations) / 11 
LESSON 3 Boundary Conditions for Diffusion-Type Problems / 19 
LESSON 4  Derivation of the Heat Equation / 27 
LESSON 5 Separation of Variables / 33 

6 


LESSON Transforming Nonhomogeneous BCs into Homogeneous 
Ones / 43 


LESSON 7 Solving More Complicated Problems by Separation of 
Variables / 49 


LESSON 8 Transforming Hard Equations into Easier Ones / 58 


LESSON 9 Solving Nonhomogeneous PDEs (Eigenfunction 
Expansions) / 64 


LESSON 10 Integral Transforms (Sine and Cosine Transforms) / 72 
LESSON 11 The Fourier Series and Transform / 81 

LESSON 12 The Fourier Transform and its Application to PDEs / 89 
LESSON 13 The Laplace Transform / 97 

LESSON 14 Duhamel’s Principle / 106 

LESSON 15 The Convection Term u, in Diffusion Problems / 112 


3 HYPERBOLIC-TYPE PROBLEMS / 124 
LESSON 16 The One Dimensional Wave Equation (Hyperbolic 
Equations) / 123 
LESSON 17 The D’Alembert Solution of the Wave Equation / 129 
LESSON 18 More on the D’Alembert Solution / 137 


LESSON 19 Boundary Conditions Associated with the Wave Equation / 
146 


LESSON 20 The Finite Vibrating String (Standing Waves) / 153 


vii 


LESSON 21 The Vibrating Beam (Fourth-Order PDE) / 161 
LESSON 22 Dimensionless Problems / 168 


LESSON 23 Classification of PDEs (Canonical Form of the Hyperbolic 
Equation) / 174 


LESSON 24 The Wave Equation in Two and Three Dimensions (Free 
Space) / 183 


LESSON 295 The Finite Fourier Transforms (Sine and Cosine 
Transforms) / 191 


LESSON 26 Superposition (The Backbone of Linear Systems) / 198 
LESSON 27 First-Order Equations (Method of Characteristics) / 205 


LESSON 28 Nonlinear First-Order Equations (Conservation 
Equations) / 213 


LESSON 29 Systems of PDEs / 223 


LESSON 30 The Vibrating Drumhead (Wave Equation in Polar 
Coordinates) / 232 


4 ELLIPTIC-TYPE PROBLEMS / 243 


LESSON 31 The Laplacian (an intuitive description) / 245 
LESSON 32 General Nature of Boundary-Value Problems / 253 
LESSON 33 Interior Dirichlet Problem for a Circle / 262 
LESSON 34 The Dirichlet Problem in an Annulus / 270 


LESSON 35 Laplace's Equation in Spherical Coordinates (Spherical 
Harmonics) / 280 


LESSON 36 A Nonhomogeneous Dirichlet Problem (Green's Functions) / 
290 


5 NUMERICAL AND APPROXIMATE METHODS / 299 


LESSON 37 Numerical Solutions (Elliptic Problems) / 301 
LESSON 38 An Explicit Finite-Difference Method / 309 


LESSON 39 An Implicit Finite-Difference Method (Crank-Nicolson 
Method) / 317 


LESSON 40 Analytic versus Numerical Solutions / 324 


LESSON 41 Classification of PDEs (Parabolic and Elliptic Equations) / 
331 


LESSON 42 Monte Carlo Methods (An Introduction) / 340 
LESSON 43 Monte Carlo Solutions of Partial Differential Equations / 
346 


LESSON 44 Calculus of Variations (Euler-Lagrange Equations) / 353 


vili Contents 


LESSON 45 Variational Methods for Solving PDEs (Method of Ritz) / 
362 


LESSON 46 Perturbation Method for Solving PDEs / 370 
LESSON 47 Conformal-Mapping Solution of PDEs / 379 


ANSWERS TO SELECTED PROBLEMS / 389 
APP. 4 INTEGRAL TRANSFORM TABLES / 399 
APP. 2 PDE CROSSWORD PUZZLE / 408 


APP. 3 LAPLACIAN IN DIFFERENT COORDINATE SYSTEMS 
| 441 


APP. 4 TYPES OF PARTIAL DIFFERENTIAL EQUATIONS / 442 
INDEX / 443 


Contents ix 


Partial 
Differential 
Equations 


for 
scientists and 
Engineers 


PART 1 


Introduction 


LESSON 4 


Introduction to Partial Differential 
Equations 


PURPOSE OF LESSON: To show what partial differential equations 


are, why they are useful, and how they are solved; also included is a brief 


discussion on how they are classified as various kinds and types. An over- 
view is given of many of the ideas that will be studied in detail later. 


Most physical phenomena, whether in the domain of fluid dynamics, electricity, 
magnetism, mechanics, optics, or heat flow, can be described in general by 
partial differential equations (PDEs); in fact, most of mathematical physics are 
PDEs. It’s true that simplifications can be made that reduce the equations in 
question to ordinary differential equations, but, nevertheless, the complete 
description of these systems resides in the general area of PDEs. 


What Are PDEs? 


A partial differential equation is an equation that contains partial derivatives. 
In contrast to ordinary differential equations (ODEs), where the unknown func- 
tion depends only on one variable, in PDEs, the unknown function depends on 
several variables (like temperature u(x,t) depends both on location x and 
time f). 

Let’s list some well-known PDEs; note that for notational simplicity we have 
called 


B o?u 


ðu a ðu 
xx ox? 


u, = — u 


y; e u 
ot Ox 


A Few Well-Known PDEs 


U, = U,, (heat equation in one dimension) 
U, = uy + Uy, (heat equation in two dimensions) 


1 1 ; —— 
U, + ur + FL = 0 (Laplace’s equation in polar coordinates) 
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U, = Uu, + uy, + us (wave equation in three dimensions) 
u, = U, + au, + Bu (telegraph equation) 


Note on the Examples 


The unknown function u always depends on more than one variable. The variable 
u (which we differentiate) is called the dependent variable, whereas the ones we 
differentiate with respect to are called the independent variables. For example, 
it is clear from the equation 

U, — Uy 


that the dependent variable u(x,t) is a function of two independent variables x 
and /, whereas in the equation 


1 1 
U, = Uu, + ur + zie 


u(r,0,t) depends on r, 0, and t. 


Why Are PDEs Useful? 


Most of the natural laws of physics, such as Maxwell's equations, Newton's law 
of cooling, the Navier-Stokes equations, Newton's equations of motion, and 
Schrodinger's equation of quantum mechanics, are stated (or can be) in terms 
of PDEs, that is, these laws describe physical phenomena by relating space and 
time derivatives. Derivatives occur in these equations because the derivatives 
represent natural things (like velocity, acceleration, force, friction, flux, current). 
Hence, we have equations relating partial derivatives of some unknown quantity 
that we would like to find. 

The purpose of this book is to show the reader two things 

1. How to formulate the PDE from the physical problem (constructing the 

mathematical model). 

2. How to solve the PDE (along with initial and boundary conditions). 
We wait a few lessons before we start the modeling problem; now, a brief 
overview on how PDEs are solved. 


How Do You Solve a Partial Differential Equation? 


This is a good question. It turns out that there is an entire arsenal of methods 
available to the practitioner; the most important methods are those that change 
PDEs into ODEs. Ten useful techniques are 
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1. Separation of Variables. This technique reduces a PDE in n variables 
to n ODEs. 

2. Integral Transforms. This procedure reduces a PDE in n independent 
variables to one in n — 1 variables; hence, a PDE in two variables could 
be changed to an ODE. 

3. Change of Coordinates. This method changes the original PDE to an 
ODE or else another PDE (an easier one) by changing the coordinates 
of the problem (rotating the axis and things like that). 

4. Transformation of the Dependent Variable. This method transforms 
the unknown of a PDE into a new unknown that is easier to find. 

5. Numerical Methods. These methods change a PDE to a system of 
difference equations that can be solved by means of iterative techniques 
on a computer; in many cases, this is the only technique that will work. 
In addition to methods that replace PDEs by difference equations, there 
are other methods that attempt to approximate solutions by polynomial 
surfaces (spline approximations). 

6. Pertubation Methods. This method changes a nonlinear problem into 
a sequence of linear ones that approximates the nonlinear one. 

7. Impulse-response Technique. This procedure decomposes initial and 
boundary conditions of the problem into simple impulses and finds the 
response to each impulse. The overall response is then found by adding 
these simple responses. 

8. Integral Equations. This technique changes a PDE to an integral equa- 
tion (an equation where the unknown is inside the integral). The integral 
equation is then solved by various techniques. 

9. Calculus of Variations Methods. ‘These methods find the solution to 
PDEs by reformulating the equation as a minimization problem. It turns 
out that the minimum of a certain expression (very likely the expression 
will stand for total energy) is also the solution to the PDE. 

10. Eigenfunction Expansion. ‘This method attempts to find the solution 
of a PDE as an infinite sum of eigenfunctions. These eigenfunctions are 
found by solving what is known as an eigenvalue problem corresponding 
to the original problem. 


Kinds of PDEs 


Partial differential equations are classified according to many things. Classifi: 
cation is an important concept because the general theory and methods 
of solution usually apply only to a given class of equations. Six basic classifi- 
cations are 
1. Orderofthe PDE. The order of a PDE is the order of the highest partial 
derivative in the equation, for example, 


u, =u (second order) 
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(1.1) 


u, = u, (first order) 
U, = uu, + Sinx (third order) 


Number of Variables. The number of variables is the number of inde- 
pendent variables, for example, 


u, = uy (two variables: x and t) 


1 1 l 
U, = U,, + —U, + -Us (three variables: r, 0, and t) 
r r 


Linearity. Partial differential equations are either linear or nonlinear. 
In the linear ones, the dependent variable u and all its derivatives appear 
in a linear fashion (they are not multiplied together or squared, for ex- 
ample). More precisely, a second-order linear equation in two variables 
is an equation of the form 


Au,, + Bu, + Cu, + Du, + Eu, + Fu = G 


where A, B, C, D, E, F, and G can be constants or given functions of 
x and y; for example, 


Uu, = e'u, + sint (linear) 
uu, + u, = 0 (nonlinear) 

Uu + yu, = 0 (linear) 

xu, t yu, + u^ = 0 (nonlinear) 


Homogeneity. The equation (1.1) is called homogeneous if the right- 
hand side G(x,y) is identically zero for all x and y. If G(x,y) is not 
identically zero, then the equation is called nonhomogeneous. 
Kinds of Coefficients. If the coefficients A, B, C, D, E, and Fin equation 
(1.1) are constants, then (1.1) is said to have constant coefficients (other- 
wise, variable coefficients). 
Three Basic Types of Linear Equations. All linear PDEs like equation 
(1.1) are either 

(a) parabolic 

(b) hyperbolic 

(c) elliptic 


Parabolic. Parabolic equations describe heat flow and diffusion processes 
and satisfy the property B? — 4AC = 0. 

Hyperbolic. Hyperbolic equations describe vibrating systems and wave mo- 
tion and satisfy the property B? — 4AC > 0. 

Elliptic. Elliptic equations describe steady-state phenomena and satisfy the 
property B? — 4AC < 0. 
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Examples. 
(a) u, = U,, B? —4AC = 0 (parabolic) 


(b) u, = un B? — 4AC = 4 (hyperbolic) 
(c) u,, = 0 B? — 4AC = 1 (hyperbolic) 
(d un +u, = 0 B? — 4AC = —4 (elliptic) 
elliptic for y > 0 
(e) yu, + uy, = 0 B? — 4AC = —4y parabolic for y = 0 
hyperbolic for y < 0 


(In the case of variable coefficients, the situation can change from point to 
point. ) 


NOTES 


1. In general, B? — 4AC is a function of the independent variables; hence, an 


equation can change from one basic type to another throughout the domain 
of the equation (although it's not common). 


2. The general linear equation (1.1) was written with independent variables 


x and y. In many problems, one of the two variables stands for time and 
hence would be written in terms of x and t. 


3. A general classification diagram is given in Figure 1.1. 


EERE T= 


FIGURE 1.1 Classification diagram for partial differential equations. 


Linearity 


Order 


Kinds of coefficients 
(linear equations) 


Homogeneity 
(linear equations) 


Nonhomogeneous 
Number of variables 


Basic type 
(linear equations) 
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PROBLEMS 


1. Classify the following equations according to all the properties we've dis- 
cussed in Figure 1.1: 


(a u, =u, +2u, + u 

(b) u, = u,, + e~ 

(c) Ust 3u,, tu, = sin x 
(d) Un =U yy xy dog 


2. How many solutions to the PDE u, = u,, can you find? Try solutions of the 
form u(x,t) = e^ +», 

3. If u,(x,y) and u,(x,y) satisfy equation (1.1), then is it true that the sum 
satisfies it?; if yes, prove it. 

4. Probably the easiest of all PDEs to solve is the equation 


du(x,y) 20 
Ox 


Can you solve this equation? (Find all functions u(x,y) that satisfy it.) 
5. What about the PDE 


Suy) _ 0 
ðxðy 


Can you find all solutions u(x,y) to this equation? (How many are there?) 
How does this compare with an ODE like 


d^y 
de 


insofar as the number of solutions is concerned? 


OTHER READING 


1. Elementary Partial Differential Equations by P. W. Berg and J. L. McGregor. Holden- 
Day, 1966. Clearly written with several nice problems; a nice book to own. 


2. Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks-Cole, 1973. 
A well-written text covering many of the topics we will cover in this book. 
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Diffusion-Type 
Problems 


LESSON 2 


Diffusion- Type Problems (Parabolic 
Equations) 


PURPOSE OF LESSON: To show how parabolic PDEs are used to 


model heat-flow and diffusion-type problems. The physical meaning of 
different terms (such as u,, u,, u,,, and u) are explained and a few examples 


of parabolic equations presented. 
The idea of an initial-boundary-value problem is introduced along with 
^ an example. One of the major goals of this lesson is to give the reader an 
intuitive feeling for parabolic-type problems. 


We begin this lesson by introducing a simple physical problem and showing how 
it can be described by means of a mathematical model (which will involve a 
PDE). We then complicate the problem and show how new partial differential 
equations can describe the new situations. The partial differential equations in 
this lesson are not derived or solved now, but will be in later lessons. 


A Simple Heat-Flow Experiment 
Suppose we have the following simple experiment that we break into steps: 


STEP 1 We start with a reasonably long (say L = 2 m) rod (say copper) 2 cm 
in diameter whose lateral sides (but not the ends) we wrap with insulation. We 
could even use copper tubing provided we pour some sort of insulation down 
the inside. In other words, heat can flow in and out of the rod at the ends, but 
not across the lateral boundary. 


STEP 2 Next, we place this rod in an environment whose temperature is fixed 
at some temperature T, (degrees °C) for a sufficiently long time, so that the 
temperature of the entire rod comes to a steady-state temperature similar to 
the environment. For simplicity, we let the temperature of the environment 
T, = 10°C. 
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STEP 3 We take the rod out of the environment at a time that we call t = 0 
and attach two temperature elements to the ends of the rod. The purpose of these 
elements is to keep the ends at specific temperatures T, and T; (say T, = 0°C 
and T, = 50°C). In other words, two thermostats constantly monitor the tem- 
perature at the ends of the rod, and if the temperatures differ from their pre- 
scribed values T, and T,, strong heating (or cooling) elements come into 
operation to adjust the temperature accordingly. Our experiment is illustrated 
in Figure 2.1. 


Heating element Thermocouples (to measure temperature) É Heating element 
that ensures the that ensures the 


emanate — oeo o LL — eene 


left end is T, right end is T, 


Screen graphing the temperature 
profile at different values of time 


FIGURE 2.4 Schematic diagram of the experiment. 


STEP 4 We now monitor the temperature profile of the rod on some type of 
display. (Why we want to perform an experiment of this kind is another question; 
we will talk about that later.) This completes our discussion of the experiment. 
The main purpose of this lesson is to show how this physical problem (and 
variations of it) can be explained (modeled) by parabolic PDEs. 


The Mathematical Model of the Heat-Flow Experiment 


The description of our physical problem requires three types of equations 
1. The PDE describing the physical phenomenon of heat flow. 
2. The boundary conditions describing the physical nature of our problem 
on the boundaries. 
3. The initial conditions describing the physical phenomenon at the start of 
the experiment. 
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The Heat Equation 


The basic equation of one-dimensional heat flow is the relationship 
Q1) | PDE u= au, O<x<L O<t<«x 


which relates the quantities 


u, = the rate of change in temperature with respect to time 
(measured in deg/sec) 


and 


u, = the concavity of the temperature profile u(x,t) (which 


essentially compares the temperature at one point to 
the temperature at neighboring points). 


This equation will be derived from the basic conservation of heat equation in 
later lessons, but for the time being, we examine it by itself. This equation 
simply says that the temperature u(x,t) (at some point along the rod x and at 
some point in time /) is increasing (u, > 0) or decreasing (u, < 0) according to 
whether u,, is positive or negative. Figure 2.2 illustrates the change in temper- 
ature at different points along the rod. 


u 


u (x, t) 


u(x + Ax, t) 


Temperature profile 
at timet 


u(x - Ax, t) + u(x + Ax, t) = Average temperature of 
the two neighbors 


x 


FIGURE 2.2 Arrows indicating change in temperature according to 
uU, = a? Uy 


To see how u,, can be interpreted to measure heat flow, suppose we approximate 
u,, by the difference quotient 


u(x,t) = E [u(x + Ax,t) — 2u(x,t) + u(x — Ax,t)] 
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Since this can be rewritten 


2 + + - 
ieee E Ax,t) + u(x — Ax,t) 


Ax? 2 g «0| 


we have the following interpretation of u,: 
1. Ifthe temperature u(x,t) < average of the two neighboring temperatures, 
then u,, > 0 (here, the net flow of heat into x is positive). 
2. Ifthe temperature u(x,t) = average of the two neighboring temperatures, 
then u,, = 0 (here the net flow of heat into x is zero). 
3. Ifthe temperature u(x,t) > average of the two neighboring temperatures, 
then u,, < 0 (here the net flow of heat into x is negative). 
This is illustrated in Figure 2.2. In other words, if the temperature at a point 
x is greater than the average of the temperature at two nearby points x — Ax 
and x + Ax, then the temperature at x will be decreasing. Furthermore, the 
exact rate of decrease u, is proportional to this difference. The proportionality 
constant a? is a property of the material, and we will discuss this constant more 
in the next few lessons. 


Boundary Conditions 


All physical problems have boundaries of some kind, so we must describe math- 
ematically what goes on there in order to adequately describe the problem. In 
our experiment, the boundary conditions (BCs) are quite easy. Since the tem- 
perature u was fixed for all time ¢ > 0 at T, and T, at the two ends x = 0 and 
x = L, we would simply say 


(2.2) BCs MM =F, Jesa 


Initial Conditions 


All physical problems must start from some value of time (generally called 
t — 0), so we must specify the physical apparatus at this time. Since we started 
monitoring the rod temperature in our example from the time the rod had 
achievéd a constant temperature of 7,, we have 


(2.3) |IC wx0-717, 0xxsL 


We have now mathematically described the experiment. By writing equations 
(2.1), (2.2), and (2.3) together, we have what is called an initial-boundary-value 
problem (IBVP) 
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PDE u, = a?u 0<x<L 0<t<o 


Xx 


u(0,t) = T, 
(2.4) BCs eae - T, 0ct«o 


IC u(x0)-2T, OsxsL 


The interesting thing here, which is not at all obvious, is that there is only one 
function u(x,t) that satisfies the problem (2.4), and that function will describe 
the temperature of the rod. Hence, our goal in the near future will be to find 
that unique solution u(x,t) to (2.4). 

Before finishing this lesson, we will discuss some variations of this basic 
problem. We start with a few modifications of the heat equation u, = a7u,,. 


More Diffusion-Type Equations 


Lateral Heat Loss Proportional to the Temperature Difference 


The equation 
U, = ocu, — B (u — Uy) B0 


describes heat flow in the rod with both diffusion a’u,, along the rod and heat loss (or 
gain) across the lateral sides of the rod. Heat loss (u > u,) or gain (u < u,) is proportional 
to the difference between the temperature u(x,t) of the rod and the surrounding medium 
u, (with B the proportionality constant). If B is very large in contrast to a’, then the flow 
of heat back and forth along the rod will be small in contrast to the flow in and out the 
sides, and, hence, the heat will drain out the sides (at each point) according to the 
approximate equation u, = — B (u — t). 


In chemistry where u may stand for concentration, the equation 
U, = ofu,, — B(u — uj) 


says that the rate of change (u,) of the substance is due both to the diffusion 
au, (in the x-direction) and to the fact that the substance is being created (u < u) or 
destroyed (u > u,) by a chemical reaction proportional to the difference between two 
concentrations u and uy. 


Internal Heat Source 


The nonhomogeneous equation 


U, = ou, + f(x, t) 
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corresponds to the situation where the rod is being supplied with an internal 
heat source (everywhere along the rod and for all time f). It may be that a wire 
carrying electrical current passes through the rod and the resistance generates 
a constant heat source f(x, t) = K. 


Diffusion-convection Equation 


Suppose a pollutant is being carried along in a stream moving with velocity v. 
It is obvious that the concentration u(x,t) of the substance changes as a function 
of both x (positive x measures the distance downstream) and time t. The rate 
of change u, is measured by the diffusion-convection equation 


uU, = œu, — vu, 


The term o?u,, is the diffusion contribution and — vu, is the convection com- 
ponent. Whether the pollutant primarily diffuses or convects depends on the 
relative size of the two coefficients o? and v. You have probably seen smoke 
rising from a smoke stack. Here, the smoke particles are convected upward with 
the hot air and, at the same time, diffuse within the air currents. 

In addition to these modifications in the heat equation, the boundary conditions 
of the rod can also be changed to correspond to other physical situations. We 
will discuss some of these modifications in Lesson 3. 


NOTES 


The heat equation u, = o?(x)u,, with a variable coefficient a(x) would correspond 
to a problem where the diffusion within the rod depends on x (the material is 
nonhomogeneous). For example, if copper and steel slabs were placed next to 
each other (see Figure 2.3) and if the left side of the copper slabs were fixed at 


= 20°C 


0 L/2 L 


> x (one-dimensional heat flow) 


FIGURE 2.3 
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u(0,t) = 0°C and the right side of the steel sheet were fixed at u(L,t) = 20°C, 
then the PDE that describes the heat flow would be 


u, = o?(x)u,, O<x<L 


where a(x) = 4% (diffusion coefficient of copper) 0< x< L/2 
a, (diffusion coefficient of steel) LIDS ee L 


PROBLEMS 


1. 


If the initial temperature of the rod were 
u(x,0) = sin «x O<x<1 
and if the BCs were 


u(0,t) = 0 
u(1,t) = 0 


what would be the behavior of the rod temperature u(x,t) for later values 
of time? 

HINT Use the physical interpretation of the heat equation u, = a7u,,. 
Suppose the rod has a constant internal heat source, so that the basic equa- 
tion describing the heat flow within the rod is 


Uu, = Qu, + 1 0cx«1 


Suppose we fix the boundaries’ temperatures by u(0,t) = 0 and 
u(1,t) = 1. What is the steady-state temperature of the rod? In other words, 
does the temperature u(x,t) converge to a constant temperature U(x) in- 
dependent of time? 

HINT Set u, = 0. It would be useful to graph this temperature. Also start 
with an initial temperature of zero and draw some temperature profiles. 
Suppose a metal rod loses heat across the lateral boundary according to the 
equation 


U, = Qu, — Bu O<x<l 


and suppose we keep the ends of the rod at u(0,t) = 1 and u(1,t) = 1. Find 
the steady-state temperature of the rod (graph it). Where is heat flowing 
in this problem? 

Suppose a laterally insulated metal rod of length L = 1 has an initial tem- 
perature of sin (37x) and has its left and right ends fixed at temperatures 
zero and 10°C. What would be the IBVP that describes this problem? 


*Note that the boundary and initial data do not match up in this problem. 
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OTHER READING 


1. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Macmillan, 
1963; Dover, 1990. An encyclopedia of information; contains many good examples and problems. 
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LESSON $ 


Boundary Conditions for Diffusion- 
Type Problems 


PURPOSE OF LESSON: To show how heat-flow and diffusion-type 


problems can give rise to a variety of boundary conditions and to introduce 
the important concept of flux. 
Three important types of BCs discussed are 


1. = g(t) (temperature specified on the boundary). 


ðu ; 
2: - + AU = g(t) (temperature of the surrounding medium is 


specified; n is the outward normal direction to the boundary). 


3. E = g(t) (heat flow across the boundary specified). 


When describing the various types of boundary conditions that can occur for 
heat-flow problems, three basic types generally come to mind. Lesson 3 discusses 
these three kinds of BCs and gives an example of how they occur in experiments. 


Type 1 BC (Temperature specified on the boundary) 


Consider the heat flow in the one-dimensional rod illustrated in Figure 3.1 
and suppose we make the ends of the rod follow the temperature curves g,(t) 


and g,(t). 


Laterally insulated 


^ 
Pd 


0 L 


— x 
FIGURE 3.1 Temperature specified on the boundary. 
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As we mentioned in the previous lesson, an apparatus that keeps the ends at 
specified temperatures requires a thermostat at each end and heating elements 
to adjust the temperature accordingly. Problems with BCs of this kind are fairly 
common. It may even be that the goal of the problem is to find the boundary 
temperatures (boundary control) g(t) and g,(t) that will force the temperature 
to behave in a suitable manner. In the steel industry, it is often necessary 
to determine the boundary controls so that the temperature of the metal inside 
the furnace changes over time but the temperature gradient from one point to 
another is small. 

Similar types of BCs also apply to higher dimensional domains, for example, 
in two dimensions, we could imagine the interesting problem of finding the 
temperature inside the circular disc (of radius R) when the boundary temperature 
is specified in polar coordinates to be 


u(R,0,t) = cost sin 0 


See Figure 3.2. 


u (R,0, t) 


(BC for different values of time) 


u (R, 0,t) » costsinO 


FIGURE 3.2 Oscillating boundary temperature. 


Of course, we’d have to have an initial temperature to get this experiment 
started, but in this case, the effects of our IC would vanish after a short period 
of time, and the resulting temperature inside the circle would depend on the 
boundary temperature. 


Type 2 BC (Temperature of the surrounding medium 
specified) | 


Suppose we consider again our laterally insulated copper rod, but now instead 
of requiring the two boundaries to be specified at temperatures g,(t) and g.;(t), 
we only bring them in contact with surrounding mediums that have those tem- 
peratures. In other words, suppose the left side of the rod is enclosed in a 
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container of liquid that has a changing temperature g,(t), while the right end is 
enclosed in another liquid with temperature g,(t) (Figure 3.3). 


Insulation 


Liquid kept at Liquid kept at 
temperature g, (t) temperature g» (t) 


FIGURE 3.3 Convection cooling at the boundaries. 


By specifying these types of BCs, we cannot say the boundary temperatures of 
the rod will be the same as the liquid temperatures g,(t) and g;(r), but we do 
know (Newton's law of cooling) that whenever the rod temperature at one of 
the boundaries is /ess than the respective liquid temperatures, then heat will 
flow into the rod at a rate proportional to this difference. In other words, for 
the one-dimensional rod with boundaries at x = 0 and L, Newton's law of 
cooling states 


0) = h[u(0,) — g(t)] 
L) = h[u(L,t) — g,(t)] 


(3.1) 


Outward flux of heat (at x 
Outward flux of heat (at x 


where A is a heat-exchange coefficient, which is a measure of how many calories flow 
across the boundary per unit of temperature difference per second per cm and the 
outward flux of heat is the number of calories crossing the ends of the rod per 
second. Note that the outward flux of heat will be positive at either end provided 
the temperature of the rod is greater than the surrounding medium. Equations 
(3.1) can now be used in conjunction with what is known as Fourier's Law of 
Cooling to arrive at our BCs. Fourier's law gives us another representation (the 
first one is 3.1) for the outward flux of heat and by setting these two represen- 
tations equal to each other, we get our BCs. First, we state Fourier’s law (proven 
experimentally): 


Outward flux of heat across a boundary is proportional to the inward 
(3.2) normal derivative across the boundary. 


This law says that if the temperature is increasing rapidly in the direction outward 
from the boundary of D (Figure 3.4), then heat will flow from the surrounding 
medium into the domain D. 


In our one-dimensional problem, Fourier's law takes the form: 


Outward flux of heat (at x = 0) = k ca 
(3.3) x 
Outward flux of heat (at x = L) = — 
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ĉu <0 (Heat flows out here) 


(Cold) 


ou > 0 Means heat flows 


in at that point n = Outward normal direction 


(Hot) 


(Cold) EM 7 Change in temperature in the 
direction » 
Qu _ Qu 
on ô (-n) 


(The derivative with respect to the 
inward normal is the negative of 
derivative with respect to the out- 
ward normal) 


FIGURE 3.4 Illustration of Fourier's law. 


where k is the thermal conductivity of the metal, which is a measure of how well 
the material conducts heat. (Poorly conducting materials have values near zero 
in cgs. units, while copper and aluminum have values close to one.) 

Fourier's law (3.3) actually holds anywhere inside the rod and not just at the 
boundary; for example, 


. . ðu 
(3.4) Flux of heat crossing xo (from left to right) = — kA ot) 


See Figure 3.5. 


Hot ux (xg, t) <0 


Uy (xg, t) > O 
Cold 


Cold 


Direction of 


a heat flow ^N 


Xo Xo 


FIGURE 3.5 Another illustration of Fourier's law. 


x 


Fourier's law (3.4) says that if u,(xo,t) < 0, then heat will flow from left to right; 
if 4, (xt) > 0, then the flow of heat through point x, will be from right to left 
(heat always flows from high to low temperatures). 
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Finally, if we use the two expressions (3.1) and (3.3) for heat flux, we have 
our desired BCs for Figure 3.3 in purely mathematical terms; namely, 


2 = (uO, — 8,00) 


0ct«o 
E , 4 [u(L,t) — g(6] 


BCs 


Quite often, the constant h/k is simply written as à, and so we have the BCs for 
heat flow across the boundary 


(3.5) u,(0,t) = A [u(0,)) — g(0] 
u(L,t) = =A [u(L,t) — gQ(t)] 


In higher dimensions, we have similar BCs; for example, if the boundary of 
a circular disc is interfaced with a moving liquid that has a temperature g(0,7), 
our BC would be 


CHR, 8,0) — = [u(R,0,1) — g(0,t)] 


ou E sae 
Here, mS represents the outward normal derivative (in the positive 


r-direction) of u evaluated at a point (R,0) on the boundary. This type of BC 
would be called a /inear BC (since it is linear in u and u,) but nonhomogeneous 
due to the right-hand side g(6,¢). 


Type 3 BC (Flux specified—including the special case of 
insulated boundaries) 


Insulated boundaries are those that do not allow any flow of heat to pass, and, 
hence, the normal derivative (inward or outward) must be zero on the boundary 
(since the normal derivative is proportional to the flux). In the case of the one- 
dimensional rod with insulated ends at x = 0 and x = L, the BCs are 


u,(0,t) = 0 
us 0 0<t<m 

In two-dimensional domains, an insulated boundary would mean that the 
normal derivative of the temperature across the boundary is zero. For example, 
if the circular disc were insulated on the boundary, then the BC would be 
u,(R,9,t) = 0 for all 0 < 0 < 2r and allO<t< o. 
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On the other hand, if we specify the amount of heat entering across the 
boundary of our disc, the BC is 


u,(R,0,t) = f(0,t) 


where f(0,t) would represent the amount of heat crossing into the circular disc 
from an outside heating source. 
We now illustrate different types of BCs. 


Typical BCs for One-Dimensional Heat Flow 


Suppose we have a copper rod 200 cm long that is laterally insulated and has 
an initial temperature of 0°C. Suppose the top of the rod (x = 0) is insulated, 
while the bottom (x = 200) is immersed in moving water that has a constant _ 
temperature of g,(#) = 20°C (Figure 3.6). 


ux (0,t) - O 
(insulated at x = 0) 


Z 


r 


Laterally insulated 


uy (200, t) = - [u (200, £) - 20] 


g(t) = 20°C (BC at x = 200) 
0<t<o 


FIGURE 3.6  Initial-boundary-value problem. 


The mathematical model for this problem would be the following four 
equations: 


PDE u = u, O<x<200 O<t<o 


u,(0,t) = 0 
(3.6) BCs been jes : [u(200,) — 20] 0ct«o 


IC — 4x0) = 0°C  0<x< 200 
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where 


o? = 1.16 cm?/sec (diffusivity constant for copper) 
k = 0.93 cal/cm-sec°C (thermal conductivity of copper) 
h = heat exchange coefficient. To find h is a hard problem in itself. It 


NOTES 


measures the rate that heat is being exchanged between the bottom 
of the rod and the surrounding water. It is a function of how fast the 
water is being circulated, the nature of the interface, and so forth. 
The reader would have to carry out an experiment to determine its 
value. 


1. A typical heat-flow problem inside a square is shown in Figure 3.7. 


Uy (x, 1, t) =O (Insulated boundary) 


ux(0, y, t) = -f, (t) 
f; (t) is the amount 
of heat crossing 
the boundary 


u, = 02 (tte ux (1, y, = - lu, £) - 10) 


(PDE) 


* uyy) 


(Temperature of surrounding 
medium is 10°C) 


u (x, O, t) = 4 (t) 
(Temperature fixed at g, (t) ) 


FIGURE 3.7 Typical BCs for diffusion problems inside a square. 


In this problem, after we specify the initial temperature u(x,y,0) at t = 0 
inside the square, the PDE and BCs in the diagram will take over for 0 « 
t < © and determine the subsequent temperature values u(x, y,t). Whatever 
the temperature is, however, it must satisfy the BCs in Figure 3.7. 


Note that the BC 


u(R,0,t) = - [u(R,0,0) - 9(0,0)] 


on the circle will not require the boundary temperature to be (0,7), but 
when the heat-exchange coefficient h is large, then the BC essentially says 


that 


the boundary temperature u(R,0,1) is almost equal to g(6,¢). 
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PROBLEMS 


1. Draw rough sketches of the solution to the IBVP (3.6) for different values 
of time. Do your sketches satisfy the BCs? What is the steady-state tem- 
perature of the rod? Is this obvious based on your intuition? 

2. What is your interpretation of the initial-boundary-value problem? 


PDE u, = a?u,, 0<x< 1 0crt«o 
u(0,t) = 0 
BCs Perg 0crt«o 


IC u(x,0) — sin (mx) 0xxx1 


Can you draw rough sketches of the solution for different values of time? 
Will the solution come to a steady state; is this obvious? 
3. What is your physical interpretation of the problem? 
PDE u, = aru 0cx«1 0<t<o 


xx 


u,(0,t) = 0 
BCs Er -0 0<t<o 


IC u(x,0) = sin (mx) 0zxxxl 
Can you draw rough sketches of this solution for various values of time? 
What about the steady-state temperature? 

4. Suppose a metal rod laterally insulated has an initial temperature of 
20*C but immediately thereafter has one end fixed at 50°C. The rest of the 
rod is immersed in a liquid solution of temperature 30°C. What would be 
the IBVP that describes this problem? 


OTHER READING 


1. Conduction of Heat in Solids by H. S. Carslaw and J. C. Jaeger. Oxford University 
Press, 1959. An excellent reference that discusses BCs of many physical problems. 


2. Partial Differential Equations in Biology by C. S. Peskin. Courant Institute of Math- 
ematical Sciences, 1976. Several biological phenomena such as nerve cells, the inner ear, 
and the cardiovascular system are modeled by PDEs. 
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LESSON 4 


Derivation of the Heat Equation 


PURPOSE OF LESSON: To show how the one-dimensional heat 


equation 


U, = u, + f(x,t) 


is derived from the basic principle of conservation of heat. Physical concepts 
such as thermal conductivity, thermal capacity, and density are discussed, 
and it is shown how the rate of heat transfer depends on these three basic 
physical parameters. A few variations of the basic heat equation are also 
discussed. 


In all areas of science, we begin with a given set of assumptions that are taken 
to be self-evident and from which all other ideas are derived. Of course, what 
is self-evident to one person may hold doubts for others. The history of science 
consists of pushing back the basic axioms further and further so that there is a 
universally agreed upon starting point. 

For example, one person may think that all relevant facts will spring from a 
basic assumption, say assumption B. From assumption B, he or she may prove 
theorem C, which in turn proves theorem D, which in turn proves others (Figure 
4.1). 


? — > AssumptionA — > AssumptionB —» Theorem C -— > Theorem D —» ? 


FIGURE 4.4 The axiomatic method. 


This of course is progress—the more new results a person can prove, the better. Physi- 
cists, chemists, and biologists all proceed in this basic manner. 

On the other hand, instead of proving new theorems we may ask if it is 
possible to find a new assumption, say assumption A, more basic than assumption 
B, so that assumption B can be proven from A. In this way, we are pushing 
back the frontiers of knowledge. In the general area of heat flow, the concept 
of conservation of energy (heat energy) is the basis from which other principles 
are derived (Figure 4.2). 
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Conservation of energy 


Other properties of 
(Assumption) 


heat flow 


— u, = ous. + f(x, t) ——» 


FIGURE 4.2 Conservation of energy: the comerstone of heat-flow problems. 


We could, of course, forget this lesson and use the heat equation as the 
starting point (some people may think it is self-evident in itself), but this would 
be shortchanging serious students, since conservation of energy assumptions are 
basic to science. Scientists often begin modeling specific problems by writing 
conservation of energy relationships and then rewriting them as partial differ- 
ential equations. 

We now turn to the goal of the lesson—to derive the heat equation from the 
conservation of heat equation. 


Derivation of the Heat Equation 


Suppose we have a one-dimensional rod of length L for which we make the 
following assumptions: 

1. The rod is made of a single homogeneous conducting material. 

2. The rod is laterally insulated (heat flows only in the x-direction). 

3. Therodisthin (the temperature at all points of a cross section is constant). 


ZA | 


x +t Ax L 
x 
Thin Conducting Rod 


FIGURE 4.3 Thin conducting rod. 


If we apply the principle of conservation of heat to the segment [x,x + Ax], we 
can claim 


Net change of heat inside [x,x + Ax] 
(4.1) — Net flux of heat across the boundaries 


+ Total heat generated inside [x, x + Ax] 


Now, inasmuch as the total amount of heat (in calories) inside [x,x + Ax] RI 
any time t is measured by (see reference 1 in this lesson) 


x+ Ax 
Total heat inside [x,x + Ax] = | cpAu(s,t) ds 


where 
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c = thermal capacity of the rod (measures the ability of the rod to store 
heat). 

p - density of the rod. 

A = cross-section area of the rod 


we can write the conservation of energy equation (4.1) via calculus as 


d x+Ax x + Ax 
(4.2) di cpAu(s,t) ds = cpA u(s,t) ds 
x+ Ax 
= kA [u,(x + Ax,t) - u(x,t] + A | f(s,t) ds 

where 

k = thermal conductivity of the rod (measures the ability to conduct 

heat). 
f(x,t) = external heat source (calories per cm per sec). 


The problem now is to replace equation (4.2) by one that does not contain 
integrals. The reader may recall the Mean Value Theorem from calculus. 


Mean Value Theorem 


If f(x) is a continuous function on [a,b], then there exists at least one number 
£ a < E € b that satisfies 


| fod = fo e - a) 


Applying this result to equation (4.2), we arrive at the following equation: 
cpAu(£, t)Àx = kA[u,(x + Ax,t) — ux] + Af(£,,t) x x «&«x + Ax 


Or 


u(i) = k fee mto se eo sanl + S&D 


Finally letting Ax — 0, we have the desired result 


(4.3) u(x,t) = a?u,,(x,t) + F(x,t) 


where 
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a? = = (called the diffusivity of the rod) 


1 
F(x,t) = oF t) (heat source density) 


This completes our discussion. Before we close, however, suppose the rod were 
not laterally insulated and that heat can flow in and out across the'lateral bound- 
ary at a rate proportional to the difference between the temperature u(x,t) and 
the surrounding medium that we keep at zero. In this case, the conservation of 
heat principle will give. 


(4.4) u, = a7u,, — Bu + F(x;t) 


where B = rate constant for the lateral heat flow (B > 0). 


NOTES 


1. The constant k is the thermal conductivity of the rod and a measure of the 
heat flow (in calories) that is transmitted per second through a plate 1 cm 
thick across an area of 1 cm? when the temperature difference is 1°C; values 
for k can be found in The Handbook of Chemistry and Physics. Typical 
values of k are close to 1 for copper and near zero for insulating-type 
materials. 

If the material of the rod is uniform, then k will not depend on x. For 
some materials, the value of k depends on the temperature u and hence the 
heat equation 


] ð 
u, = "m {k(u)u,} 


is nonlinear. Most of the time, however, k changes very slowly with u and 
this nonlinearity is neglected. 

2. The constant c is known as the thermal capacity (or specific heat) of the 
substance and measures the amount of energy the substance can store. For 
example, a baked potato would have a large thermal capacity, since it can 
store a large amount of heat per unit mass of potato (that's why it takes a 
long time to heat). Technically, the thermal capacity is the amount of heat 
(in calories) necessary to produce a 1?C change in temperature of 1 g of the 
substance. For most of our problems, c is taken as a constant independent. 
of x and u; typical values can be found in The Handbook of Chemistry and ` 
Physics. 

3. The units of some of the basic quantities of heat flow (in the cgs. measure- 
ment system) are 

u — temperature (degrees centigrade). 
u, = rate of change in temperature (°C/sec). 
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u, = slope of temperature curve (^C/cm). 

u,, = concavity of temperature curve (^C/cm?). 
c = thermal capacity (cal/g-°C). 

k = thermal conductivity (cal/cm-sec-?C). 

p = density (g/cm?). 

o? = diffusivity (cm?/sec). 


RRI. k re . 
4. Note that the diffusivity o? = e of a material is proportional to the con- 


ductivity k of the material and inversely proportional to the density p and 
thermal capacity c; this should have some intuitive appeal to the reader. 


PROBLEMS 


1. Substitute the units of each quantity uu, . . . into the equation 
u, = œu, — Bu 


to see that every term has the same units of °C/sec. 
2. Substitute the units of each quantity into the equation 
U, = o)u,, — vu, 


where v has units of velocity to see that every term has the same units. 
3. Derive the heat equation 


2 [ku] + flat) 


_id 
cp ox 


t 
for the situation where the thermal conductivity k(x) depends on x. 

4. Suppose u(x,t) measures the concentration of a substance in a moving stream 
(moving with velocity v). Suppose the concentration u(x,t) changes both by 
diffusion and convection; derive the equation 

uU, = a*Uu,, — vu, 
from the fact that at any instant of time, the total mass of the material is 


not created or destroyed in the region [x, x + Ax]. 
HINT Write the conservation equation 


Change of mass inside [x, x + Ax] 
— Change due to diffusion across the boundaries 
+ Change due to the material being carried across the boundaries 
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OTHER READING 


1. Applied Mathematics for the Engineer and Physicist by L. A. Pipes. McGraw-Hill, 
1958. An older reference, but still a good one for the practicing scientist. 


2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Mac- 
millan, 1963; Dover, 1990. A good text for derivations of equations. A companion volume, 
A Collection of Problems in [on] Mathematical Physics, by B. M. Budak, A. A. Samarskii, and 
A. N. Tikhonov (Pergamon, 1964; Dover, 1988) is available, which will give the student additional 
experience with solving problems in partial differential equations. 
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LESSON 5 


oeparation of Variables 


PURPOSE OF LESSON: To introduce the powerful method of sep- 
aration of variables and to show how this method can be used to solve a 
well-known diffusion problem. Inasmuch as the method is not well under- 
stood by some students due to its complicated algebraic nature, several 
intuitive explanations are given along the way. 


The basic idea is to break down the initial conditions of the problem 
into simple components, find the response to each component, and then 
add up these individual responses. This gives the response to the arbitrary 
initial condition. 

The actual step-by-step methodology of separation of variables some- 
what hides this basic interpretation, but that's what's going on nevertheless. 


Separation of variables is one of the oldest techniques for solving initial- 
boundary-value problems (IBVPs) and applies to problems where 
1. The PDE is linear and homogeneous (not necessarily constant coeffi- 
cients). 
2. The boundary conditions are of the form 


au,(0,t) + Bu(0,t) 


0 
yu,(1,t) + Su(1,t) = 0 


where a, B, y, and 8 are constants (boundary conditions of this form are 
called linear homogeneous BCs). 
It dates back to the time of Joseph Fourier (in fact, it’s occasionally called 
Fourier’s method) and is probably the most widely used method of solution 
(when applicable). 

Instead of showing how the method works in general, let’s apply it to a specific 
problem (later we will discuss it in more generality). Consider the IBVP (dif- 
fusion problem) 

PDE u, = aru 0<x<1 0ct«o 


xXx 


u(0,t) = 0 
BCs P -0 0O<t<« 


Separation of Variables 33 


IC u(x,0) = d(x) O<x<l 


u (x, 0) = ¢ (x) = initial temperature 
(Steady state obviously = 0) 


u=0 


(Heat sink) (Heat sink) 


FIGURE 51 Diagram of the diffusion problem. 


Before getting to separation of variables, let's first think about our problem. 
Here we have a finite rod where temperature at the ends is fixed at zero (suppose 
it’s a temperature problem where zero means so many degrees). We are also 
given data for the problem in the form of an initial condition; our goal is to find 
the temperature u(x,t) at later points in time. 

Now for the method itself—but first an overview. 


Overview of Separation of Variables 
Separation of variables looks for simple-type solutions to the PDE of the form 
u(x,t) = X(x)T(t) 


where X(x) is some function of x and T(t) is some function of t. The solutions 
are simple because any temperature u(x,t) of this form will retain its basic 
"shape" for different values of time t (Figure 5.2). 


u (x, 0) = T (0) X(x) 
u (x, 1) = T(1) X(x) 
u (x, 2) = T(2) X(x) 


0 1 


FIGURE 5.2 Graph of X(x)T(t) for different values of f. 


The general idea is that it is possible to find an infinite number of these solutions 
to the PDE (which, at the same time, also satisfy the BCs). These simple func- 
tions u,(x,t) = X,(x)T,(t) (called fundamental solutions) are the building blocks 
of our problem, and the solution u(x,t) we are looking for is found by adding 
the simple fundamental solutions X,(x)T, (t) in such a way that the resulting sum 


X AXT, 
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m 


satisfies the initial conditions. Inasmuch as this sum still satisfies the PDE and 
the BCs, we now have the solution to our problem. Let's now carry this out in 
detail. 

Separation of Variables 

STEP 1 (Finding elementary solutions to the PDE) 


We wish to find the function u(x,t) that satisfies the following four conditions: 


PDE U, = o?u,, 0cx«1 0<t<x 
u(0,t) = 0 
BCs jew = 0 O<t<« 


IC u(x,0) = o (x) O<x<1l 


To begin, we look for solutions of the form u(x,t) = X(x)T(t) by substituting 
X(x)T(t) into the PDE and solving for X(x)T(t). Making this substitution gives 


X(x)T'(t) = 02X"(x) T(t) 


Now, here is the part that makes all this work: If we divide each side of this 
equation by a2X(x)T(t), we have 

T() X) 

Tt) X(x) 


and obtain what is called separated variables, that is, the left side of the equation 
depends only on ¢ and the right side, only on x. Inasmuch as x and ¢ are inde- 
pendent of each other, each side must be a fixed constant (say k); hence, we can 
write 


AP < 

er ^x 7^ 
Or 

T’ — ko’T = 0 

X" - kX = 0 


So now we can solve each of these two ODEs, multiply them together to get 
a solution to the PDE (note that we have essentially changed a second-order 
PDE to two ODEs). However, we now make an important observation, namely, 
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that we want the separation constant k to be negative (or else the T(t) factor 
doesn't go to zero as t — œ). With this in mind, it is general practice to rename 
k = —X?, where à is nonzero ( — X? is guaranteed to be negative). Calling our 
separation constant by its new name, we can now write the two ODEs as 


T + No?T = 0 
X' + VX = 0 


We will now solve these equations. Both equations are standard-type ODEs and 
have solutions 


T(t) = Ae^"** (A an arbitrary constant) 
X(x) = A sin (Ax) + B cos (Ax) (A, B arbitrary) 


and hence all functions 

u(x,t) = e-"** [A sin (Ax) + B cos (Ax)] 
(with A, B, and arbitrary) will satisfy the PDE u, = a7u,,; this verification is 
problem 1 in the problem set. At this point, we have an infinite number of 
functions that satisfy the PDE. 
STEP2 (Finding solutions to the PDE and the BCs) 
We are now to the point where we have many solutions to the PDE but not all 
of them satisfy the BCs or the IC. The next step is to choose a certain subset 
of our current crop of solutions 
(5.1) e^ a’ A sin (Ax) + B cos (Ax)] 


that satisfy the boundary conditions 


u(0,t) = 0 
u(1,t) = 0 


To do this, we substitute our solutions (5.1) into these BCs, getting 


u(0,t) = Be" =0>B = 0 
u(1,t) = Aee" sind = OD sind = 0 


This last BC restricts the separation constant à from being any nonzero number, 
it must be a root of the equation sin A = 0. In other words, in order that 


u(1,t) = 0, it is necessary to pick 


NS bay tly. EMOPI.: 
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Or 


À, = tnm n=1,2,3,... 


Note that the last BC could also imply A = 0, but if we choose this, we would 
get the zero solution in (5.1). 

We have now finished the second step; we have found an infinite number of 
functions 


each one satisfying the PDE and the BCs.* These are the building blocks of the 
problem, and our desired solution will be a certain sum of these simple functions; 
the specific sum will depend on the initial conditions. See Figure 5.3 for the 
graphs of these fundamental solutions u,(x, t): 


STEP 3 (Finding the solution to the PDE, BCs, and the IC) 


The last step (and probably the most interesting from a mathematical point of 
view) is to add the fundamental solutions 


u(x,t) = >) A,e- "79" sin (nmx) 
n=1 


in such a way (pick the coefficients A,) that the initial condition 
u(x,0) = (x) 


is satisfied. Substituting the sum into the IC gives 
(5.3) (x) = > A, sin (nmx) 
n=] 


This equation leads us to the interesting question asked by the French mathematician 
Joseph Fourier, is it possible to expand the initial temperature (x) as the sum of the 
elementary functions as follows: 


A, sin (Tx) + A, sin (27x) + A, sin (3mx) +... 


The answer to this question is yes provided (x) is a reasonably nice function— 
continuous. Hence, the question now becomes how to find the coefficients A,,. 


* Notice that the functions u, and u_, are essentially the same except for a minus sign. 
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ui(x, t) =A; e 12?* sin (gx) 


0 


FIGURE 5.3 Fundamental solutions u,(x,f) = Ae- sin (nmx). 


This is actually very easy: One uses a property of the functions 
{sin (nx); n=1,2,...} 


known as orthogonality. It turns out (see problem 2) that these functions are 
orthogonal to each other in the sense 


0 m+n 


1 
f sin (max) sin (ntx) dx = l D e 


This property can be illustrated by looking at the graphs of these functions 
(Figure 5.4). 
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sin (7x) 


FIGURE 5.4 Orthogonal sequence of functions. 
So, we are now in position to solve for the coefficients in the expression 


d(x) = A, sin (nx) + A, sin (27x) + A, sin (3mx) + A, sin (4mx) +... 


We multiply each side of this equation by sin (mmx) (m, an arbitrary integer) 
and integrate from zero to one; doing this, we get 


1 l 
1 
| o(x)*sin (mmx) dx = A,, | sin? (mmx) dx = aA 


n 


(all other terms drop out due to orthogonality). Solving for A, gives 
1 
Am = 2 l p(x) sin (mmx) dx 


We're done; the solution is 


(5.4) u(x,t) = >) A,e- "79" sin (nmx) 
n=1 


where the coefficients A, are given by 


(5.5) A, = 2 f (x) sin (ntx) dx 


We can check this answer to see that it satisfies all four of our original conditions 
in the problem. This ends step 3. 

Many students are disappointed when they finally discover that the solution 
is this complicated, and many hardly give the solution a second look (that’s too 
bad). The solution is not all that difficult if one takes the time to analyze it; in 


Separation of Variables 39 


fact, the more complicated it is, the more information it contains. Here are a 
few notes that will help you interpret this solution. 


NOTES 


1. 


Observe that the only difference between the Fourier sine expansion of (x) 
in (5.3) and the solution (5.4) is the insertion of the time factor 


e (72 
in each term. Hence, if our IC were a very simple expression like 
; l. 
(x) = sin (mx) + 5 sin (31x) 
then the solution would simply be 


1 i 
u(x,t) = e- C?" sin (mx) + on sin (37x) 


In this case, it's obvious that if we expanded ¢(x) as a Fourier sine series, we 


would get 
A, = 1 
A, = 0 
A, — 
A, = A, = . >è c = 0 
2. We can interpret the solution (5.4) in the following manner: We expand the 


initial temperature (x) as a sum of simple functions, A, sin (nx) and then find the 
response to each of these (which is A,e-("79" sin (nma); and then add these individ- 
ual responses to get the solution corresponding to the IC u(x,0) = (x). 


The terms in the solution 


u(x,t) = A,e~™” sin (nx) + A;e- C79" sin (2mx) +... 


are functions of x and t. Note that the terms further out in the series get 
small very fast due to the factor 


e^ (nma)? 


Hence, for long time periods, the solution is approximately equal to the 
first term 
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u(x,t) = A,e-'7«" sin (mx) 


which is the shape of a damped sine curve (Figure 5.5). 


@ (x) = initial temperature 

Note that the solution 

starts to lose the higher t=0 
frequencies first—small 
wiggles vanish first. 


x 


FIGURE 5.5 Higher-order terms damp faster in diffusion problems. 


PROBLEMS 


1. Show that u(x,t) = e~’** [A sin (Ax) + B cos (Ax)] satisfies the PDE u, 
= o7u,, for arbitrary A, B, and À. 


1 
_ JO m+n 
2: Show [ sin (mmx) sin (mnx) dx = p" "i een 
HINT Use the identity 


sin (mx) sin (nx) = [cos (m — n)x — cos (m + n)x] 


3. Find the Fourier sine expansion of (x) = 1 0 «€ x <1. Draw the first 
three or four terms. 


4. Using the results of problem 3, what is the solution to the IBVP 


PDE U, = U,, 0cx«1 
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(Note that this problem is physically impossible, since we are pulling the 
temperature from one to zero instantaneously. In most problems, if the BCs 
are zero, then the initial temperature (x) should also be zero at x = 0 and 
x — 1.) 


5. What is the solution to problem 4 if the IC is changed to 


1 
u(x,0) = sin (27x) + = sin (47x) + z sin (61x) 


6. What would be the solution to problem 4 if the IC were 


u(x,0) = x — x? 0cxc«l1l 


OTHER READING 


Partial Different Equations of Mathematical Physics by Tyn Myint-U. Elsevier, 1973. A 
well-written text slightly more advanced than the current one; Chapter 6. A large chapter 
on separation of variables with several good problems. 
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LESSON 6 


Transforming Nonhomogeneous 
BCs into Homogeneous Ones 


PURPOSE OF LESSON: To show how the initial-boundary-value 


problem 
PDE U, — QU, = f(x,t) 


a,u,(0,t) + B,u(0,t) = gr) 
ES beri + Bu(L,t) = g,(t) 


IC u(x,0) = (x) 


can be transformed into a new one (with zero BCs) like 


U, — 07U,, = F(x,t) 
a,U,(0,t) + B,U(0,t) = 0 
a,U,(L,t) + B,U(L,t) = 0 
U(x,0) = (x) 


This new problem can then be solved by 
1. Separation of variables if the new PDE just happens to be homo- 
geneous [F(x,t) = 0]. 
2. Integral transforms and eigenfunction expansions if F(x,t) # 0. 


Although the method of separation of variables that we discussed in the last 
lesson is very powerful and gives us a nice series solution, the reader should 
realize it doesn’t apply to all problems. In order for separation of variables to 
apply, the BCs must be of the following form (linear homogeneous BCs): 


(6.1) a,4,(0,t) + B,u(0,r) = 0 
a,u,(L,t) + B,u(L,t) = 0 


The purpose of this lesson is to show how problems with nonhomogeneous BC 
like 
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PDE u, = ou, 
r au ,(0,t) T B.u(0,r) ES g(t) 
(6.2) BCs Ea L,t) + Bu(L,t) = el) (nonhomogeneous BCs) 


IC u(x,0) = (x) 


can be solved by transforming them into others with zero BCs. The new problem 
can then be solved by other methods (like eigenfunction expansions). We start 
our discussion by transforming an extremely simple problem with nonhomo- 
geneous BCs into one with zero BCs. 


D Nonhomogeneous BCs to Homogeneous 
nes 


Consider heat flow in an insulated rod where the two ends are kept at constant 
temperatures k, and k,; that is, 


PDE U, = a?u,, O<x<L 0O<t<a 
u(0,t) = k, 
(6.3) BCs P E 0crt«o 


IC u(x,0) = (x) O<x=<L 


The difficulty here is that since the BCs are not homogeneous, we cannot solve 
this problem by separation of variables. However, it is obvious that the solution 
will have a steady-state solution (solution when t = æ) that varies linearly (in 
x) between the boundary temperatures k, and k, (Figure 6.1). 


u 


t=0 


u (x, 0) = d(x) = initial temperature 


k, à 


U (x, 0) = transient temperature 
att - 0 


FIGURE 6.1 Solution of (6.3) for various values of time. 
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In other words, it seems reasonable to think of our temperature u(x,t) as the 
sum of two parts 


u(x,t) = steady state + transient 


Eventual solution Part of the solution that 
for large time depends on the IC (and 
will go to zero) 
x 


L (kK, — kj)] + U(x,t) 


This being the case, our goal is to find the transient U(x,t). By substituting 


= [k, + 


x 


u(x,t) = [k, + I. 


(kı — kj)] + Ut) 


in the original problem (6.3), we will arrive at a new problem in U(x,t). We can 
then solve this new one for U(x,t) and add it to the steady state to get u(x,t). 
Carrying out this simple substitution in (6.3) gives us 


PDE U, = œU, O<x<L 


U(0,t) = 0 2 
(6.4) BCs EM -0 0<t< 


x 
IC U(x,0) = o(x) - [k, + L (kı — k,)] 
SSS ee 
N 
$(x) = new IC—but known 
This problem (fortunately) has a homogeneous PDE as well as homogeneous 


BCs, and so we can solve it by separation of variables; in fact, the reader 
probably remembers the solution: 


(6.5) U(x,t) = > a,e- "= sin (nmx/L) 
nal 


where 


a, = 2| BO sin (nm¥/L) dt 


So much for rods with fixed temperatures at the boundaries. What about 
more realistic-type derivative BCs with time-varying right-hand sides? The ideas 
are similar to the previous problem but a little more complicated. 
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Transforming Time Varying BCs to Zero BCs 


Consider the typical problem 


PDE U, = au, 0<x<L 0<t<o 
u(0,t) = g(t 0<t<o 
eo) oe Br + hu(L,) = gj) 


IC u(x,0) = (x) O<x<L 


To change these nonzero BCs to homogeneous ones, we (after some trial and 
error) seek a solution of the form 


(6.7) u(x,t) = A(0[1 — x/L] + B(O[x/L] + U(x,t) 
where A(t) and B(t) are chosen so that the steady-state part 
(6.8) S(x,t) = A(0[1 — x/L] + B(O[x/L] 


satisfies the BCs of the problem. In this way, the transformed problem in U(x, t) 
will have homogeneous BCs. Substituting S(x,t) into the BCs 


S(0,t) = g,(t) 
S(L,t) + hS(L,t) = g(t) 


gives us two equations in which we can solve for A(t) and B(t). Doing this, 
we get 


(6.9) A(t) = gi(t) 
B(t) = zn : EU 


Hence, we have 


u(x,t) = g (DIL — xL] + gone [x/L] + U(x,f) 


and so if we substitute this into the original problem (6.6), we get our transformed 
problem in U(x,t) (the reader should do this) 
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(6.10) BCs | 


PDE U, = o?U,, — S, (nonhomogeneous PDE) 


U (L, + hU(L,t) = 0 


U(0,t) = 0 (homogeneous BCs) 


IC U(x,0) = d(x) — S(x,0) (new IC—but known) 


We now have our new problem with zero BCs (unfortunately, the PDE is 
nonhomogeneous). We can't solve this problem by separation of variables, but 
if the reader can wait for a few lessons, we will solve it by integral transforms 
and eigenfunction expansions. 


NOTES 


l. 


Our goal in this lesson was to transform problems with nonhomogeneous 
BCs into those with zero BCs. In so doing, if the new PDE just happens 
to be homogeneous, we are fortunate (like the first example) because we 
can then solve the problem by separation of variables. 

If, on the other hand, the new transformed PDE is nonhomogeneous, 
then we must solve the new problem by some other method. 


2. The most general nonhomogeneous linear BCs 
au, (0,4) + B,u(0,t) = g(t) 
au, (Lt) + Bju(L,t) = gx) 
can also be transformed into zero BCs in a manner similar to the technique 
in the second example. Of course, the new PDE would most likely be 
nonhomogeneous. 

3. Some methods of solution do not require the BCs to be homogeneous at 
all, and, hence, it isn’t necessary to make any preliminary transformation. 
Later, when we study the Laplace transform, we will see it isn’t necessary 
to have zero BCs (it’s just that it’s sometimes easier). 

4. For BCs of the form 

u(0,t) = g,(t) 
u(L,t) = g,(t) 
the method discussed in the second example will give us the transformation 
x 
u(x,t) = (eO + 7 [e - gO + UO) 
PROBLEMS 
1. Solve the initial-boundary-value problem 
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PDE u, = u, 0<x<1 


u(0,t) = 1 
BCs po + hu(i,) = 1 sm 


IC u(x,0) = sin(mx)+ x O0sxsxsl1 
by transforming it into homogeneous BCs and then solving the transformed prob- 
lem. Does the solution agree with your intuition of the problem? 


2. Transform 


PDE U, = us, 0cx«1 


u(0,t) = 0 
BCs Py. Si 0cr«o 


IC u(x,0) = x? 0zxxl1 
to zero BCs and solve the new problem. What will the solution to this 
problem look like for different values of time? Does the solution agree with 
your intuition? What is the steady-state solution? What does the transient 
solution look like? 
3. Transform 


PDE U, = U,, 0cx«1 


u,(0,t) = 0 
SS Pr + hul =1 95!'97 


IC u(x,0) = sin (vx) 0xxxl 


into a new problem with zero BCs; is the new PDE homogeneous? 


OTHER READING 


Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks-Cole, 
1973. This excellent text contains an extensive section on transforms of the type we 
discuss in this lesson and a good section on separation of variables. 
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LESSON 7 


oolving More Complicated 
Problems by Separation of 
Variables 


| 
| PURPOSE OF LESSON: To show how more complicated heat-flow 
| problems can be solved by separation of variables. This lesson essentially 
| consists of a worked problem that will give the reader more familiarity 
with the method. Hopefully, the reader will be able to extrapolate the 
| ideas presented here to solve problems on his or her own. 
Eigenvalue problems, known as Sturm-Liouville problems, are intro- 
duced, and some properties of these general problems are discussed. 


The purpose of this lesson is to solve an initial-boundary-value problem by the 
separation of variables method that the reader might have trouble working on 
his or her own. Hopefully, the reader can extrapolate from this problem to other 
problems not specifically mentioned in this text. 

We start with a one-dimensional heat-flow problem where one of the BCs 
contains derivatives. 


Heat-Flow Problem with Derivative BC 
Consider an apparatus 


u (0,0720 
(temperature fixed at O) 


Rod laterally insulated 


7 
uy (1,t)+ A u(1,0 70 


Temperature of water = 0 


FIGURE 71 Diagram for the initial-Doundary-value problem. 
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in which we fix the temperature at the top of the rod at u(0,¢) = 0 and immerse 
the bottom of the rod in a solution of water fixed at the same temperature of 
zero (zero refers to some reference temperature). The natural flow of heat 
(Newton's law of cooling) says that the BC at x — 1 is 


u, (1,t) = — hu (1t) 


u 


Heat flows out (hot > cold) 
u, (1, t) = -ku (1, t) 


0 1 
u(0,f) = O 


FIGURE 7.2 The nature of curves with BCs uf) = -hult 


Suppose now the initial temperature of the rod is u(x,0) = x, but instantaneously 
thereafter (t > 0), we apply our BCs. To find the ensuing temperature, we must 
solve the IBVP 


PDE U, = au, 0<x<1 0crt«o 
u (0,t) = 0 
(7.1) BCs E (LÀ + hu (1,1) = 0 (homogeneous BCs) 


IN 


IC u (x0) =x Osx<l 
To apply the separation of variables method, we carry out the following steps: 


STEP 4 (Separating the PDE into two ODEs) 
Substituting u(x, t) = X(x)T(t) into the PDE gives 


XT' = o?X'T 
and dividing by a?XT, we get 
C ANIME S 
cT X 


50  Diffusion-Type Problems 


Since the left-hand side depends only on time and the right-hand side depends 
only on x (and since x and t are independent), both sides of this equation raust 
be constants. Setting them both equal to p gives the two ODEs 


(7.2) T — pa’T = 0 
X" — pX = 0 


We have now completed the separation process. 
STEP 2 (Finding the separation constant) 
First of all, ju must not be positive or else T(t) will grow exponentially to infinity 
(which would make u = XT go to infinity—which we can reject on physical 
grounds). 
Secondly, suppose m = 0. This being the case, we have 
X" = 0 

and thus 

X(x) = A + Bx 


But since the BCs of the problem are 


u (0, t) = X(0)T(t) = 0 
u, (1,t) + hu(1,) = X (DT() + hX) T(t) = 0 


we could conclude that 


X (0) =0 A =0 
X'(1) +hX0) 207 B=0 


which would mean u(x,t) = 0. In other words, p = 0 gives only u = 0; hence 
we throw it out (we are looking for nonzero solutions). 


Finally, if p < 0, we call y = —A? and write the two ODEs (7.2) as 
T' + \Na2?T = 0 
X' + VX = 0 


which gives us solutions 


T(t) = Ae~ 00 
X(x) = B sin (Ax) + C cos (Ax) 


Hence, what we have is that any function 
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(7.3) u(x, t) = e-99"' [A sin (Ax) + B cos (Ax)] 


for any A and any A and B will satisfy the PDE (the reader can verify this 
calculation on his or her own). What we'd like to do now is find out how many 
of these functions will satisfy the BCs 


(7.4) u (0,4) = 0 
u, (1,t) + hu (1, 1) = 0 


Substituting the solution (7.3) into the BCs (7.4) gives us conditions on A, A, 
and B that must be satisfied; namely, 


Be ^" = 0>B=0 
Ade~° cos A + hAe-% sind = 0 


Performing a little algebra on this last equation gives us our desired condition 
on À 


tan à = —A/h 


In other words, to find A, we must find the intersections of the curves tan \ and 
— A/h (Figure 7.3). 


FIGURE 7.3 Graph showing intersections of tan (A) and —X/h. 
These values 4,, A2,. . . can be computed numerically for a given h on a computer 


and are called the eigenvalues of the boundary-value problem 


X -XX-20 
(7.5) X (0) = 0 
X'(1) + hX (1) = 0 
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In other words, they are the values of à for which there exists a nonzero solution. 
The eigenvalues X, of (7.5), which, in this case, are the roots of tan A = 
— Mh, have been computed (for h = 1) numerically, and the first five values 
are listed in Table 7.1. 


TABLE 71 Roots of 


tanA = -À 
n N, 
1 2.02 
2 4.91 
3 7.98 
4 11.08 
5 14.20 


The solutions of (7.5) corresponding to the eigenvalues A, are called the 
eigenfunctions X,(x), and for this problem, we have 


X,(X) = sin (À,x) 


See Figure 7.4. 


X 


X, (x) = sin (A,x) 


All eigenfunctions 
have BC: 


X'(1) + X(1) =0 


FIGURE 7.4 Eigenfunctions X(x of (7.5) for h = 1. 


STEP 3 (Finding the fundamental solutions) 
We now have an infinite number of functions (fundamental solutions), 


u, (x, t) = X, (x) T,(t) = e ~~” sin (A,x) 


each one satisfying the PDE and the BCs. The final step is to add these functions 
together (the sum will still satisfy the PDE and BCs, since both the PDE and BCs 
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are linear and homogeneous) in such a way that they agree with the IC when 
t = 0; that is, we sum 


=x 


> 4,X,, (x) T, (t) 


nal 


u(x, t) 


Y. a,e7 9" sin (A,X) 

n=1 

so that the IC u(x,0) = x is satisfied. In other words, 

(7.6) u(x, 0) = x = > a, sin (A,x) 
n=1 


This brings us to our final step. 


STEP 4 (Expansion of the IC as a sum of eigenfunctions) 
To find the constants a, in the eigenfunction expansion (7.6), we must multiply 
each side of the equation by sin (A,,x) and integrate x from 0 to 1; that is; 


[ ksin 0.9 dt = $ a, |, sin (48) sin Anë) dt 


1 
= Am f sin? (,,£) dE 
Am — Sin À,, COS ,, 
= A m ———————————— 
2^, 


Solving for a,, (we'll change the notation to a,), we get our desired result 


2, D 
(7.7) d CEA A) f € sin (A,£) d£ 
In other words, our solution to (7.1) is 
(7.8) u (x,t) = 2, ae ^" sin (x) 


where the constants a, are given by (7.7). In this problem, the first five constants 
a, have been computed and are listed in Table 7.2. 
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TABLE 7.2 Coefficients 
a, in (7.8) 


a, 


n 

1 0.24 
2 0.22 
3 — 0.03 
4 — 0.11 
5 — 0.09 


Hence, the first three terms of the IBVP 


PDE u, =u O<x<1 0O<t<a 


u (0,t) = 0 
(7.9) BCs E (Lt) + u(1,t) = 0 0O<t<e« 
IC u(x,0) =x Osx<1 


are 


u(x, t) = 0.24 e~* sin (2x) + 0.22 e^?" sin (4.9x) 
+ 0.03e-9' sin (7.98x) +... 


The graph of this solution is drawn for various values of time in Figure 7.5. The 
reader can ask himself or herself if this solution agrees with his or her intuition 
and whether or not it satisfies the BCs of the problem. 


{Note that the BC 
ux(1, t) * u(1, t) =0 
is always satisfied] 


0 Steady state = 0 1 


FIGURE 7.5 Solution to (7.8). 
NOTES 


The eigenvalue problem (7.5) is a special case of the general problem 
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ODE [p(x) y l — q(x)y + Ar(x)y = 0 0<x<1 


ay (0) + B,y'(0) = 0 
ave p (1) + By'(1) = 0 


(7.10) 


known as the Sturm-Liouville problem. When we solve PDEs by separation of 
variables with linear homogeneous BCs, the ODE in X(x) along with its BCs 
will always be some particular Sturm-Liouville problem. We observe that the 
eigenvalue problem (7.5) is a special case of (7.10). 

What Sturm and Liouville proved is that under suitable conditions on the 
functions p(x), q(x), and r(x), the problem (7.10) has 


1. An infinite sequence of eigenvalues 
AjKA;WAMX&...«AM,&...—0 


2. Corresponding to each eigenvalue A,, there is one nonzero solution 
y, (x) [not including other constant multiples of y, (x)]. 


3. If y,(x) and y,,(x) are two different eigenfunctions (corresponding to A, 
+ Nm), then they are orthogonal with respect to the weight function r(x) 
on the interval of [0,1]; that is, they satisfy 


] r ya) ynl) dx = 0 


More details of Sturm-Liouville-type problems can be found in references 1 
and 2. 


PROBLEMS 


1. Solve the following heat-flow problem: 


PDE u =u, O<x<1 0<t<% 


IC u(x,0) = x Oxx<l 


by separation of variables. Does your solution agree with your intuition? 
What is the steady-state solution? 


2. What are the eigenvalues and eigenfunctions of the Sturm-Louiville problem 
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ODE X'-AX20 0<x<l 


X(0) = 0 
aid ma - 0 


What are the functions p(x), q(x), and r(x) in the general Sturm-Liouville 
problem for this equation? 


3. Solve the following problem with insulated boundaries: 


PDE U, = U,, 0<x< 1 0<t< 


u,(0,t) = 0 
BCs by. -0 0ct«o 


IC u(x0)-x Osxxxil 


Does your solution agree with your interpretation of the problem? What is 
the steady-state solution?; does this make sense? 


4. What are the eigenvalues and eigenfunctions of 


ODE X' + XX = 0 0<x<1 


X0) = 0 
a F (1) = 0 


OTHER READING 


1. Elementary Differential Equations and Boundary-Value Problems by W. E. Boyce 
and R. C. DiPrima. John Wiley & Sons, 1965. Chapter 11. This is an ordinary-differential- 
equations text that contains an excellent section on the Sturm-Liouville problem, one of 
the better undergraduate texts in ODEs. 

2. Advanced Engineering Mathematics by E. Kreyszig. John Wiley & Sons, 1967. This 
text contains many worked examples of typical problems; very readable. 


Solving More Complicated Problems by Separation of Variables 57 


LESSON & 


Transforming Hard Equations into 
Easier Ones 


PURPOSE OF LESSON: To show how one can transform a PDE in 


u(x,t) into a new (easier) one in a new variable w(x,t). The transformation 
is generally based on intuition, and in this lesson, the PDEs 


u, = a*u,, — Bu 
u, = a7u,, — vu, 


are transformed into the simple heat equation 


ei- "I2y2o y ( x, t) 


After the transformations are made, the heat equation (the easy one) can 
be solved for w(x,t), hence, 


u = e Pw(x,t) 
u = e - 2V2 W(x, t) 


are the solutions of the original equations (of course, the BCs and the IC 
must be transformed too). 


The reader may get the impression from the last two lessons that the only type 
of PDE that can be solved by separation of variables is 


u, = o?u 


xx 


It is true the heat equation is the easiest parabolic PDE to solve by separation 
of variables, but it is in no way the only equation we can solve by this technique. 
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As mentioned earlier, as long as the equation is linear and homogeneous, we 
can separate variables. For example, two-dimensional heat flow inside a circle 
would be described by the equation 


u, = alu ic T 
t rr y^ y? 9 


and although it has variable coefficients, it can still be separated into three ODEs. 

This lesson will show the reader that sometimes a PDE doesn't have to be 
attacked directly but that the original PDE can be transformed into an easier 
one. In this way, the easier problem can be solved (by separation of variables 
or some other technique). We now present an example that illustrates this 
technique. 


Transforming a Heat-Flow Problem with Lateral Heat 
Loss into an Insulated Problem 


Consider the following problem: 


PDE U, = a7u,, — Bu 0<x<1 0<t<% 
u(0,t) = 0 
(8.1) BCs PE Lo O<t<” 


IC u(x,0) = (x) O<sx<l 


where the term — Qu represents heat flow across the lateral boundary (Figure 
8.1). 


Lateral heat loss across the sides 


— rn 


u(0,t) =O Diffusion within the rod ,t)=0 


FIGURE 84 Heat flow described by u, = e?u,, — gu. 


The goal of this lesson is to introduce a new temperature w(x,t) in place of 
u(x,t), so that the PDE in w is simpler than the original one 


u, = ^u, - pu 
This is a common technique in PDEs, and the transformation is generally based 
on an intuitive feeling of how the solution of the original PDE behaves. For 
example, in our problem (8.1), the temperature u(x,t) at any point x, is changing 


as a result of two phenomena 
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1. diffusion of heat within the rod (due to a7u,,). 

2. heat flow across the lateral boundary (due to — Bu). 
The important point is that if there were no diffusion within the rod (a = 0), 
then the temperature at each point x, would “damp” exponentially to zero 
according to 


U(Xo,t) = u(xs 0)e * 


By means of this observation, we wonder if we can essentially decompose the 
temperature u(x,t) of problem (8.1) into two factors 


(8.2) u(x,t) = e-P'w(x,t) 
or 
Noninsulated temperature = e^? (insulated temperature) 
where w(x,t) would represent the temperature due to diffusion only. Let's see 


what happens if we substitute this expression into problem (8.1); this is a routine 
calculation (the reader can do it on his or her own), and we arrive at 


PDE W, = QW, 0<x<1 0crt«o 
w(0,t) = 0 
(8.3) BCs pe -0 0ct«o 


IC w(x,0) = (x) O<x<1 
This is exactly the same problem we started with except that now the PDE 
doesn’t contain — Bu; so all we have to do to solve (8.1) is solve the transformed 


problem (8.3) and then multiply the solution w(x,t) by e~ *'. In this case, we have 
already solved (8.3) previously by the separation of variables method and found 


w(x,t) =. >, a,e- "79" sin (nux) 
(8.4) n=l 


a, = 2 [| (sin (n) dé 


and, hence, the solution of the original problem (8.1) is 
u(x,t) = e-P'w(x,t) 


The following example in the notes is solved by this technique. 
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NOTES 


1. To solve the problem 


u, = uu —U 0<x<1 0<t<% 


u(0,t) = 0 
u(1,t) = 0 
u(x,0)= sin (nx) + 0.5 sin (37x) 


by the preceding strategy, we 
(a) neglect the convection term —u for the time being. 
(b) solve the initial-boundary-value problem without the term —u to 
get 
u(x,t) = e~™ sin (ux) + 0.5 e- 9?" sin (37x) 


(c) multiply this solution by the convection factor e~® = e~‘ to get the 
solution 


u(x,t) = e^' [e^ "* sin (nx) + 0.5 e- 9?" sin (3mx)] 
2. The diffusion-convection equation 
U, = aU, — vu, 
(v is a constant) can also be transformed to 
W, = o?W,, 
In this case, the transformation is 
u(x,t) = eed w(y t) 
This transformation essentially factors out the part of the solution (expo- 
nential factor) that is due to the moving medium. Note that the exponential 
factor consists of a moving exponential (moving to the right with velocity 


v/2). The reader will get a chance to use this transformation in the problem 
set. 


PROBLEMS 


1. Solve the diffusion problem 
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PDE U, = U, — U, 0<x<1 0ct«o 


u(0,t) = 0 
BCs ee 52 0ct«o 
IC u(x,0) = e"? 0xxx1 


by transforming it into an easier problem. What does the solution look like? 
We could interpret this problem as describing the concentration u(x,t) in a 
moving medium (moving from left to right with velocity v — 1) where the 
concentration at the ends of the medium are kept at zero (by some filtering 
device) and the initial concentration is e"?. Does your solution agree with 
this interpretation? 

2. Solve the problem 


—u-x 0«x«1 0ct«o 
BCs M MEET 


IC u(x,0) = 0 0xxxl 


by 
(a) changing the nonhomogeneous BCs to homogeneous ones. 
(b) transforming into a new equation without the term — u. 
(c) solving the resulting problem. 


3. Solve 
PDE U, = U, — U 0c€x«1 0ct«o 
u(0,t) = 0 
BCs fey, -0 0<t<o 


IC u(x,0) = sin (qx) 0xxxl 
directly by separation of variables without making any preliminary trans- 
formation. Does your solution agree with the solution you would obtain if 
the transformation 


u(x,t) = e^'w(x,t) 


were made in advance? 
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OTHER READING 


Nonlinear Partial Differential Equations in Engineering by W. F. Ames. Academic Press, 
1965. This text discusses many types of transformations for changing old problems into 
new ones, so that sometimes even nonlinear problems can be transformed into linear 
ones. 
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LESSON 9 


solving Nonhomogeneous PDEs 
(Eigenfunction Expansions) 


PURPOSE OF LESSON: To show how to solve the initial-boundary- 


value problem 


PDE u, = o?u,,  f(x,t) 0<x<1 0<t «o 


a,u,(0,t) + B,u(0,4) = 0 - 
Bes — + Bou(1,r) X 0 : E 
IC u(x,0) = (x) 


A nonhomogeneous PDE can be solved by finding a series solution of the 
form 


u(x,t) = Y, TX.) 


where the X,(x) are the eigenfunctions we find when solving the associated 
homogeneous problem 


PDE U, = Qu, 0<x<1 0<t< œ% 


a,u,(0,t) + B,u(0,t) = 0 
nes pu + pu) =0 SISO 


IC u(x,0) = (x) 


and 7,(t) are functions that can be found by solving a sequence of ODEs. 


In Lesson 6, we discussed how transformations could be made to transform 
nonhomogeneous BCs into homogeneous ones. Unfortunately, the PDE was left 
nonhomogeneous by this process, and we were left with the problem 
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PDE U, = a7u,, + f(x,t) 0«x«1 0crt«o 


a,u,(0,t) + B,u(0,t) = 0 7 
M a + Bul =0 9*'* 


IC u(x,0) = (x) 0xxx1 


The purpose of this lesson is to solve this problem by a method that is analogous 
to the method of variation of parameters in ODEs and is known as the eigen- 
function expansion method. 

The idea is quite simple. Inasmuch as the solution of (9.1) with f(x,t) = 0 
(so-called corresponding homogeneous problem) is given by 


u(x,t) = 2, ae e" X (x) 
n=1 


where à, and X,(x) are the eigenvalues and eigenfunctions of the Sturm-Liouville 
problem, 

XW + nvX = 0 
(9.2) a,X'(0) + g,X(0) = 0 

o,X'(1) + g,X(1) = 0 


we ask whether the solution of the nonhomogeneous problem (9.1) can be 
written in the slightly more general form 


u(x,t) = >) T,()X,(2) 


n=1 
The reason for this speculation is physically appealing, inasmuch as a source of 


heat f(x,t) within the rod will give rise to a new time component and not the 
damping factor 


e Ove 


as was the case when the only input into the problem was the IC. 
To show how this method works, we apply it to a simple problem so the 
details aren't as complicated. 


Solution by the Eigenfunction Expansion Method 


Consider the nonhomogeneous problem 
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PDE U, = Qu, + f(x,t) 0<x<1 0crt«o 


0.) = 0 
(9.3) BCs Fey ae 0<1<x 


IC u(x,0) = o(x) 0xxxl 
To solve this problem, we divide the procedure into the following steps: 


STEP 1 The basic idea in this method is to decompose the heat source f(x, t) 
into simple components 


fot) = AOX) + AXE) +... + AOX) +... 


and find the response u,(x,t) to each of these individual components f„(t)X,„(x). 
The solution to our problem is then 


x 


u(x,t) = 3, u(x,t) 


n= 


To determine how to decompose f(x, ¢) into its component parts f,(t)X,,(x) is one 
of the major problems. It turns out that the X,(x) factors in this problem are 
the eigenvectors of the Sturm-Liouville system we get when solving the associated 
homogeneous problem to (9.3) by separation of variables; that is, 


U, = Qu, (note that f(x,t) = 0) 


(9.4) u(0,t) = 0 
u(1,t) = 0 
u(x,0) = (x) 


in this case, the Sturm-Liouville problem we find when separating variables is 


X' + 2X =0 
X(0) = 0 
X(1) = 0 


and, hence, the X,(x) are 
X,(x) = sin (nmx) n=1,2,... 
Hence, our decomposition of the heat source has the form 
(9.5) f(x,t) = fi(t) sin (nx) + f£(d sin ex) +... + f(t) sin (anx) +... 
Finally, to find the functions f,(t), we merely multiply each side of this 
equation by sin (mx) and integrate from zero to one (with respect to x); 


hence, we have 
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f | f(x,t) sin (mmx) dx = » f. t) f | sin (mmx) sin (nmx) dx 
1 
= 5 fall) 
or (changing m to n) 
(9.6) fat) = 2 | | f(x,t) sin (amx) dx 


This will give us an equation for the coefficients f,(f) in terms of the heat 
source f(x, t). 


STEP 2 (Find the response u,(x,f) = T,(t)X,(x) to input f,(t)X,,(x)) 
We now replace the heat source f(x,t) by its decomposition 


f(x,t) = > f,(2) sin (anx) 
n=1 
and try to find the individual responses 
u(x,t) = > T,(t) sin (nux) 
n=) 


in other words, we seek the functions 7,(t). Knowing these, the answer to our 
problem is 


u(x,t) = > T,(t) sin (nux) 
n=1 
Substituting u(x,t) = >) T,(t) sin (nux) into the system 
n=1 


u, = œu, + >, f,(t) sin (nux) 
n-l 


u(0,t) = 0 
u(1,t) = 0 
u(x,0) = (x) 


gives us 
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oc 


YT T'(t) sin (nmx) = —o? > (nmyT,(t) sin (nmx) + 5 f, (t) sin (nmx) 


= n 


AT w(t) sin 0 = 0 (says nothing; zero — zero) 
(9.7) "_ 
> T,(t) sin (nm) = (says nothing; zero = zero) 


X T,(0) sin (nmx) = (x) 
Rewriting the PDE and the IC as 
PDE piu + (nnay) T, — f,(t)] sin (nmx) = 
IC Xr sin (nix) = (x) 
we can see fairly easily that 7,,(t) will satisfy the simple initial value problem 


(9.8) T, + (nnayT, = f(t) 


T,(0) = 2 | (© sin (nmà) dt = a, 


This ODE is one of the easier ones to solve (use an integrating factor) and has 
the solution 


t 


(9.9) T,(t) = a,e "79^ + f e om9Y0-9 f (T) d« 
Hence, the solution of problem (9.3) is 
(9.10) u(x,t) = > T,(t) sin (nux) 

nl 


= Y [ae - *79"* sin (nex)] + Y [sin (nx) f | e^ 996-9 f. (4) d«] 


| 


Transient part Steady state 
(because of the initial condition) (because of the right-hand side f(x, t)) 


We can see from this solution that the temperature response is due to two parts: 
the first part that is due to the IC and the second part that is due to the heat 
source f(x,t). The phrase steady state is not the best phrase to describe the 
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second part, since it doesn't necessarily come to rest (it may approach a periodic 
steady state, if f(x,t) is periodic in 2). 

This completes the problem. Before stopping, however, we will show how 
this method can be applied to a specific example. 


Solution of a Problem by the Elgenfunction-Expansion 
Method 


Consider the simple problem 


PDE U, = a7u,, + sin (37x) 0<x<1 
u(0,t) =0 
(9.11) BCs "M -0 0crt«o 


IC u(x,0) = sin (mx) 0xxxl 


Our goal is to compute the coefficients T,„(t) in the expansion 


2c 


u(x,t) = Y, T,(t) sin (nux) 
n=l 
(the eigenfunctions X,(x) are still the same for this problem). If we substitute 


this expansion in the problem, we will get an ODE for the functions T,,(t) 
In fact, we will get 


1 
T. + (nnayT, = f,(t) =2 Í sin (37x) sin (nmx) dx = l : 4 : 


T,(0) = 2 f sin (m£) sin (nm£) dë = {0 : 7 l 


Writing out these equations for n = 1, 2,..., we see 
0-2 Foor s T(t) = emo 
usn oo E Tr) = 0 
mas Ag!» no = gapt - eom 
we Jor ls T,(t) = 0 
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Hence the solution of our problem is 


(9.12) u(x,t) = e- C9" sin (mx) + [1 — e-O79"] sin (3«x) 


NM 
(31a)? 


Transient Steady state 
(because of initial conditions) (because of the right-hand side of the PDE) 


NOTES 


1. The method of eigenfunction expansion is one of the most powerful for 
solving nonhomogeneous PDEs. Later, when we study integral transforms, 
we will see that there are other methods for solving these types of problems. 

2. The eigenfunctions X, (x) in the expansion change from problem to problem 
and depend on the PDE and BCs. The reader should look at problem 4 in 
the problem set to make sure he or she knows how to find the eigenfunctions 
X, (x). 

3. Ifthe reader remembers ODE theory, he or she will remember that solutions 
of equations corresponding to nonhomogeneous terms like 


Pe) ein (Rr) 


could be found by the method of undetermined coefficients. The same is true 


here. Problem (9.11) could be solved by this method. Any reader interested 
in this method should consult the reference. 


PROBLEMS 


1. The solution of the problem 


PDE U, = U, + sin (3mx) 0<x<1 


u(0,t) = 0 
BCs m 0 0crt«o 


IC u(x,0) = sin (mx) 0xxxl 
is given by (9.12). Does this solution agree with your intuition? What does 
the solution look like? 


2. Solve the problem 


PDE u, = U, + sin (mx) + sin (2mx) 0<x<1 0<t<o 
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0O<t<o 


(0,4) = 0 
DS M = 0 


IC u(x,0) = 0 0xxxl 


3. Solve the problem 


PDE u, = U,, + sin (mx) 0<x<1 0<t<o 
u(0,t) = 0 
BCs d 0ct«o 


by the method of eigenfunction expansion. 
4. Find the solution of 


PDE U, = U, + sin (yx) 0<x<1 0<t<o 
u(0,t) = 0 
PES eS pude Ve 


IC u(x,0)=0 Os<x<l 


by the method of eigenfunction expansion where à; is the first root of the 
equation tan A = —2A. What are the eigenfunctions X,(x) in this problem? 
5. Solve the problem 


PDE U, = Uy 0<x<1 0<t<a 
u(0,t) = 0 
BCs ice, 0O<t<oa 


IC u(x,0) =x Osxsl 


by 

(a) transforming it to one with zero BCs. 

(b) solving the resulting problem by expanding it in terms of eigenfunc- 
tions. 


OTHER READING 


Elementary Partial Differential Equations by P. W. Berg and J. L. McGregor. Holden- 
Day, 1966. One of the more popular texts on PDEs; slightly more advanced than this 
text; clearly written. An extensive section on nonhomogeneous problems (Chapter 5). 
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ussoN 10 


Integral Transforms (Sine and 
Cosine Transforms) 


PURPOSE OF LESSON: To introduce the idea of integral transforms 
and show how they transform PDEs in n variables into differential equa- 
tions in n —1 variables. 

It is also shown that these transforms can be interpreted as resolving 
the input of the problem into simple parts (frequency resolution), finding 
the solution for each subpart, and adding the results. 


Jn summary, integral transforms change differentiation to multiplication, 
and, hence, certain partial derivatives are changed into algebraic expres- 
sions. 

The sine and cosine transforms are introduced and are used to solve an 
infinite-diffusion problem. The solution is interesting in that it involves the 
complementary-error function. 


An integral transformation is merely a transformation that assigns to one function 
f(t) a new function F(s) by means of a formula like 


F(s) = l, K (s,t)f(t) dt 


Note that we start with a function of t and end with a function of s. The function 
K(s,t) is called the kernel of the transformation and is the major ingredient that 
distinguishes one transform from another; it is chosen so that the transform has 
certain desirable properties. The limits of integration A and B also change from 
transformation to transformation. 

The general philosophy behind integral transformations is that they eliminate 
partial derivatives with respect to one of the variables; hence, the new equation 
has one less variable. For example, if we apply a transform to the PDE 

U, = Uy, 


for the purpose of eliminating the time derivative, then we would arrive at an 
ODE in x. On the other hand, if we had the PDE 
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Us + Uy, + uu 0 


and applied the Fourier transform to the x-variable, then we would eliminate 
the derivative u,, and would have a new PDE in y and z. We could, of course, 
apply the Fourier transform again to eliminate one of the other variables (and 
arrive at an ODE in the last remaining variable). In other words, integral trans- 
forms change problems into easier ones. The transformed problem is then solved, 
and its inverse is obtained to find the solution to the original problem; this 
general strategy is illustrated in Figure 10.1. 


Solution 
of 
easy 
problem 


Easy Solve the easy problem 
problem (Step 2) 


Integral transform Inverse transform 
(Step 1) (Step 3) 


Solution 
of 
hard 
problem 


i 
Hard Obstacle 


problem 


FIGURE 101 General philosophy of transforms. 


In Figure 10.1, we see that along with every integral transform, there is an 
inverse transform that will reproduce that original function from its transform. 
The transform and its inverse together form what is called a transform pair. 
Table 10.1 lists several common transform pairs that we will use to solve PDEs. 


TABLE 10.4 Some Common Transform Pairs 


Transform pairs 


(Fourier sine transform) 


Sf] = F(o) = Z | f(t) sin (wt) dt 


I. 

F- [F] = KÀ = [ F(w) sin (wt) dw (inverse sine transform) 

2 [7 . ; 

F [f = F(w) = . f f(t) cos (wt) dt (Fourier cosine transform) 
2: 

SF = f(t) = | F(w) cos (wt) do (inverse cosine transform) 

1 [7 

Ff] = F(o) = Vag f fœ) e`dx (Fourier transform) 

3. 


F- [F] = f(x) = z io edw (inverse Fourier transform) 
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2 L 
F = S, = T | f(x) sin (nmx/L) dx (finite-sine transform) 


g-[F]-f(x)- Y, S, sin (nux/L) (inverse finite-sine transform) 
n=1 


F 

F 
S$[f] = F(s) = [ro e-* dt (Laplace transform) 
£ 


HÍf] = F, (6) = id rJ(&r)f(r) dr (Hankel transform) 
H 


2 L 
Af] = C, = L | f(x) cos (nmx/L) dx . (finite-cosine transform) 
- GS | ee 
TF) = f(x) = a + >» C, cos (nmx/L) (inverse finite-cosine transform) 


n=1 


[A 


1 
[F] = f(t) = ni | F(s)e* ds (inverse Laplace transform) 


[E] = fr) = | J,(&)F,(E£) d& ^ (inverse Hankel transform) 


Note that in these transforms we have alternative notations. For instance, in 
the case of the Laplace transform, the notation Æ [f] indicates that we are taking 
the transform of f, whereas the alternative notation F(s) indicates a function 
of s. 

The current lesson does not attempt to study all of these transform pairs— 
only the sine and cosine transforms (1. and 2.); later, we will study several of 
the others. Questions about the relationship between the transforms, when to 
apply them, advantages and disadvantages of each, will be answered as we go 
along. However, before we begin the study of integral transforms, it will be 
useful to study what is called the spectrum of a function (or the spectral resolution 
of a function). 


The Spectrum of a Function 


Integral transforms and the spectrum of a function are closely related; in fact, 
an integral transformation can be thought of as a resolution of a function into 
a certain spectrum of components. How the transform actually resolves the 
function changes from transform to transform, but the function is being resolved 
into something nevertheless. 

For instance, let's consider the resolution of a periodic funciton f(x) into sines 
and cosines (Fourier series)* 


* Fourier series will be discussed in detail in Chapter 11. 
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x 


f(x) = > [A, cos (nx) + B, sin (nx)] 


n=0 


(Figure 10.2). 


A square wave approximated by sines and cosines 


FIGURE 10.2 Expansion of a periodic function into sines and cosines. 


Here, the coefficients A, and B, represent the amount of the function f(x) made 
up by cos (nx) and sin (mx), respectively, while the square root 


VA; + B; 


(called the spectrum of the function) measures the amount of f(x) with 
frequency n. | 
For example, if the function f(x) were a simple sum of sines and cosines 


1 
f(x) = 1 + sinx + = sin (3x) + cosx + ; cos (2x) + z 008 (4x) 


then its spectrum (discrete) would be as given in Figure 10.3. 


FIGURE 10.3 Discrete spectrum of f(x). 


By reading off the values of \/A?, + B?,, we can tell the magnitude of the 
component in f(x) with frequency n. 
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Functions that are periodic can be resolved into infinite series (they have 
discrete spectrums), whereas functions that are not periodic must be resolved 
into a continuous spectrum of values (of course, if a function is defined only on 
a finite interval, we could extend the function outside the interval in a periodic 
way, so that a Fourier series representation could be obtained for the function 
inside the interval). 

For example, although a nonperiodic function f(x) cannot be represented by 
an infinite series of sines and cosines, we might be tempted to write it as a 
continuous analog of the Fourier series; that is, 


f(x) = |. [C(e) cos (wx) + S(w) sin (wx)] dw 


where the functions S(w) and C(w) measure the sine and cosine component of 


f(x) and 


w) + w 


measures the w frequency component of f(x) and is called the spectrum (contin- 
uous spectrum) of f(x). 

With this intuitive explanation of the spectrum of a function, we now get to 
the nuts and bolts of integral transforms. The first step would be to list a few 
properties of these transforms that make them work. 


Sine and Cosine Transforms of Derivatives 
1. FF] = -w FI] (proved by integration by parts) 
FII = = fO - oF 


3. 9f] =ERO + oF, [f 


4. FIP] = -EFO - Ff 


(10.1) 


Several other sine and cosine transforms and their inverses can be found in the 
tables at the end of the lessons. We now show how the sine transform can solve 
an important initial-boundary-value problem. 


Solution of an Infinite-Diffusion Problem via the Sine 
Transform 


The problem we are interested in is the infinite diffusion problem 
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PDE U, = Qu, 0<x<% 0ct«o 
BC u(0, t =A 0<t<on 
IC u (x, 0) = 0 O<x<am 


(Figure 10.4). 


y(x, 0) 20 
FIGURE 10.4 Diffusion problem in a semi-infinite-medium. 


STEP 4 To solve this, we break it into three simple steps. First our strategy is 
to transform the x-variable via the Fourier sine transform so that we get an ODE 
in time. We start by transforming each side of the PDE; in other words 


F [u] = F [un] 
Let's consider each term individually: 


¥[u,]: The partial derivative u, in this problem is what we could call the off 
derivative, since our transform is with respect to x. In this case, we can write 


oc 


F [u,] Z [ u,(x,t) sin (wx) dx 


- E { Tann ax| 


at Jo 


d 

di Su] 
d 

EU U(t) 


The fact that we took the derivative outside the integral is a property from 
calculus. Note that u is a function of x and t, whereas its transform 

F [u] = U(w,t) 
is a function of w and t. The new variable w will be treated like a parameter in 


the new problem, and, hence, we call the sine transform a function of t alone; 
that is, 
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gu] = U(t) 


¥[u,,|: For this one, we have the identity 


Flua] = 5 ou) - oF {ul 


= wu(0,1) - w(t) 


_ 2Aw " 
ne o?U(t) 


Note here that when you proved these identities (10.1), you did it for functions 
of one variable f(x). We now have a slight modification, since u(x,t) depends 
on x and ¢. You should use the formulas according to which variable is being 
transformed and treat the others as constants. In this case, the transform is with 
respect to x, and, hence, ¢ is just carried along as a constant. Also note that the 
BC u(0,t) = A is used at this point in our operation. 

Substituting these expressions into our PDE, we arrive at the ODE 


dU  , 3 2Aw 
di = a ouo + 2 


The only thing missing is an IC for U(t); we get this by transforming the IC 
u (x,0) = 0 to get 


%,[u(x,0)] = U(0) = 0 


This completes the first step in the transform process—we have changed the 
Original problem into an initial-value problem 


2 
ODE dU + wa U = 2Awa* 
(10.2) dt " 
IC U(0)=0 


STEP 2 To solve this IVP, we could use a variety of elementary techniques 
from ordinary differential equations (integrating factor, homogeneous and par- 
ticular solution); in any case, the solution is 


U() = Aa — e-san 
TW 


We have now found the sine transform for the answer u(x,t). The last step is 
to find the inverse transform of U(t); that is, 


u(x,t) = F- '[U] 
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STEP 3 To find the solution, we can either evaluate the inverse transform 
directly from the integral or else resort to the tables. Using the tables, we 
see that 


u(x,t) = A erfc (x/2aN/t) 


where erfc(x), 0 < x « o, is called the complementary-error function and is 
given by 


erfc(x) = | e^" dt 


See Figure 10.5 for its graph. 


i erf (x) = Error functio 
V edt 


(erf (x) + erfcix)] = 1 


erfc (x) 


FIGURE 10.5 Graphs of erf(x) and erfc(x). 


The exact values of these well-known functions can be found in most tables for 
physics and chemistry. It should be noted that these integrals cannot be inte- 
grated by the usual elementary tricks of calculus. 


Interpretation of the Solution 


The solution 
u(x,t) = A erfc [x/2a Vt] 


makes a lot of sense. For different values of time, we have the graph of a 
complementary-error function with different scale factors on the x-axis. As time 
increases, the error function gets pulled out; for a graph of the solution at 
different values of time, see Figure 10.6. 


FIGURE 10.6 Solution to semi-infinite rod with fixed temperature A at the end. 
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PROBLEMS 


EAR IAM RECETA SU C ESO TMRE UICE UM MET ELM DE C CHUNG CEC E EU Ce IC ME ETIN 
l. Prove the identities (10.1). What assumptions do you need to assume about the 
function f? 

2. Solve the ordinary-differential equation problem (10.2). 


3. Solve by means of the sine or cosine transform 


PDE U, = o?u,, 0cx«o 
BC u(0,) 0 O0-cr«o 
IC u(x,0) = H(1—-x) Osxxc«o 


where H(x) is the Heaviside function: 


0 0zx«l 
Ho = T 1x 


In other words, the IC looks like 


0 1 


What does the graph of the solution look like for various values of time? 


OTHER READING 


1. Operational Mathematics by R. V. Churchill. McGraw-Hill, 1958. An excellent text 
covering many of the integral transforms; good problems and many tables. 


2. Tables of Integral Transform by A. Erdelyi. McGraw-Hill, 1954. One of the most 
comprehensive tables of integral transform. 


3. Integral Transforms in Mathematical Physics by C. J. Tranter. Chapman and Hall 
(Science Paperbacks), 1971. A small, but concise paperback; easy to read with many 
examples. 
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LESSON 11 


Ihe Fourier Series and Transform 


PURPOSE OF LESSON: To introduce the Fourier series and to show 


how it can represent certain periodic functions f(x) by sums of sines and 
cosines: 


f(x) = 5 + P [a, cos (nox) + b, sin (nmx)] 


In the case of nonperiodic functions on ( —9, o), to show also how the 
Fourier series is replaced by the Fourier transform and how a function f(x) 
can be represented by a continuous resolution of simple functions. This 
resolution (the Fourier integral) can be written in the complex form 


fe) = o. RT [fae ar ee di 


which gives rise to the Fourier and inverse Fourier transforms 


Ff] = F(£) = E |. f(x)e-'* dx (Fourier transform) 


FF] = f(x) = = [. F(&)e'* dé (inverse Fourier transform) 


The importance of the Fourier series in PDE theory is that periodic functions 
f(x) defined on ( — ©, œ) or functions defined on finite intervals can be represented 
by infinite series of sines and cosines, and in this way, problems can be resolved 
into simple ones. For example, the so-called sawtooth wave 


f(x) =x -L«x«L 
f(x + 2L) = f(x) (periodic condition) 


shown in Figure 11.1 
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FIGURE 11.1 Sawtooth wave represented by a Fourier series. 


can be represented by the Fourier series 


(11.1) 


where the Fourier coefficients a, and b, are given by the Euler formulas 


ll 
- 
s 

I 

e 
m 
N 


1 L 
(11.2) an= T |. fo cos (nmx/L) dx 


b,= Z f. f(x) sin (nmx/L) dx -(2L/nm)(-1" n =1,2,.. 


These integrations are routine calculus evaluations. To find Euler’s formulas for 
a, and b,, respectively, we multiply each side of equation (11.1) by sin (nx) or 
cos (nx) and integrate the resulting equation from — L to L. The orthogonality 
of the functions {sin (nmx/L)) and {cos (nmx/L)) allows us to solve for the coef- 
ficients a, and b,; see problem 6. For the sawtooth wave, the Fourier represen- 
tation is given by 


(11.3) f(x) = = [sin (ux/L) — = sin (2nx/L) + = sin (3nx/L) — .. | 


where each term (called harmonic) has a larger frequency than the previous 
term, and all frequencies are multiples of a fundamental frequency that has the 
same period as the function f(x) | 

One of the drawbacks of the Fourier series is that in order for a function to 
have a Fourier series representation, the function must be periodic. Of course, 
if we want to expand a function (say, f(x) = x for 0 = x < 1) defined on a finite 
interval, we could use expansion (11.1). The fact that the Fourier series is periodic 
outside the interval [0,1] doesn't concern us, since we're only interested in the 
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function inside the interval. As a matter of fact, we can represent a function 
inside an interval with many different types of Fourier series by considering 
different types of extensions outside the interval (some converge faster than 
others). 

The reader shouldn't get the idea that every periodic function can be rep- 
resented by a Fourier series expansion. What we do know is that if a function 
f(x) can be represented by a Fourier series (11.1), then the coefficients a, and 
b, are given by the Euler formulas (11.2). What's more, even if a function f(x) 
can be represented by a Fourier series, it isn't always true that the derivative 
f (x) can be found by differentiating the series term by term. In fact, we can 
easily see that the derivative of f(x) = x (the sawtooth function) cannot be found 
by differentiating each term of the Fourier series (11.3). Indeed, the differen- 
tiated series will not even converge for any x (the reader can verify this himself 
or herself). 

The exact conditions that insure that a function f(x) will have a Fourier series 
representation and that the representation can be differentiated term by term 
are found in the recommended reading for this lesson. For our purposes, we are 
content to know the important result of P. G. Dirichlet's (Deer-ish-lay) theorem, 
which states 


- Dirichlet's theorem (sufficient conditions for a function to have a Fourier 
series representation): 


| 
| If f(x) is a bounded periodic function that contains a finite number of 
maximum points, minimum points, and points of discontinuity in each period, 
then the Fourier series of f(x) converges to f(x) at each point x where f(x) 
is continuous and to the average of the left- and right-hand limits of f(x) at 
those points where f(x) is discontinuous. 


For example, in Figure 11.1, the Fourier series converges to the function f(x) 
for all except x = +L, +3L, ... (points of discontinuity), in which case it 
converges to zero (the average of + L and — L). 

We are now almost ready to introduce the Fourier transform. Before we do, 
however, it will be useful to introduce the idea of the frequency spectrum of a 
periodic function. 


Discrete Frequency Spectrum of a Periodic Function 


For periodic functions, we can interpret the Fourier series as the replacement 
of a periodic function f(x) by a sequence {c,} of numbers 


c, = Val + b nc 1 2 es 
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where the numbers c, can be taken as measuring the contributions of the various 
frequency components of the function f(x). For example, the sawtooth wave f(x) 
has the Fourier series representation 


f(x) = E [sin (mx/L) — = sin (2mx/L) + = sin (3nx/L) — .. | 


and, hence, the frequency spectrum {c,} is c, = 2L/nm for n = 1,2,... and 
E E = 0 (Figure 11.2). 


fix) 


A 
(Fundamental frequency) (n-th harmonic) 
Period 2L Period 2L/n 


FIGURE 11.2 Discrete frequency spectrum of the sawtooth wave. 


The sequence (c,) is somewhat similar to the decomposition of white light into 
the frequency spectrum of colors obtained with a spectroscope. 
We now introduce the Fourier transform. 


The Fourier Transform 


The major difficulty with Fourier series representation is that nonperiodic func- 
tions defined on ( — œ,%) cannot be represented. It is possible, however, to find 
an analogous representation for some of these functions. Without going through 
the details of the proof, we can show that the Fourier series representation 


f(x) = 2 t X [a, cos (nmx/L) + b, sin (nmx/L)] 


changes to the Fourier integral representation (continuous frequency resolution) 


(11.4) —— fe) = | at cos (£x) dt + |. b sin (Ex) dt 


where 


- 
(11.5) a(t) =~ | fo) cos (Ex) de 


bO - L| ft) sin (Ex) ax 
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for nonperiodic functions defined on (— 9,9). Here, we see that the Fourier 
integral representation has resolved the function f(x) into all frequencies 0 « 
£ < œ (and not just multiples of one basic frequency, as with periodic functions). 
As we did in the Fourier series, we define the frequency spectrum 


CCE) = VÆG) + PE 


which measures the composition of the function f(x) in terms of its frequencies. 
Some examples of functions f(x) and their frequency spectrums are given in 
Figure 11.3. 


c 


fix) C(t) = 5(E - £g) 


Impulse at £g 


f (x) = sin (Ex) 


Eo 


C(£) 


f (x) 
sin $ 


E 


Cit) = Jt 


C(£) 


f (x) 


CAE) = v 2n(1+ £2) 


FIGURE 11.3 Frequency spectra for various functions. 
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Note that functions f(x) that have sharp corners give rise to frequency spectra 
with large frequencies, since sharp corners require high-frequency components 
to represent them. On the other hand, the simple periodic function f(x) = 
sin (£x) obviously has a frequency spectrum that is zero everywhere except 
até = &. 

We are now in a position to define what is generally known as the exponential 
Fourier transform (Equations 11.5 are known as the Fourier sine and cosine 
transforms). By use of Euler’s (Oy-ler) equation 


e? = cos 6 + i sin O 


we can rewrite equation (11.4) after a little effort as 


(11.6) ee a t |n |. f(x)je-'* ax e^ dt 


which is known as the Fourier integral representation. From this, we can write 
the two equations 


Ff] = F(£) -Ux [. f(x)e"™ dx (Fourier transform) 


(11.7) o 
F- [F] = f(x) = = |. F(£)e'* dé (inverse Fourier transform) 


which are the Fourier and inverse Fourier transforms. Properties of this trans- 
form pair will be discussed in the next lesson along with problems using these 
transforms. 


NOTES 


1. The Fourier transform F(&) of f(x) can be a complex function; for example, 
the Fourier transform of 


"om E $e 


2. The absolute value of the Fourier transform F(£) is the frequency spectrum 
of f(x). For example, in note 1, the frequency spectrum of f(x) is 
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|F(é)| = PUTENT 


(the reader should be able to find the magnitude of a complex number). 

3. Notall functions have Fourier transforms [the integral (11.7) may not exist]; 
in fact, f(x) = c, sin x, e", x?, do not have Fourier transforms. Only functions 
that go to zero sufficiently fast as |x| — © have transforms. In applications, 
we apply the Fourier transform to temperature functions, wave functions, 
and other physical phenomena that go to zero as |x| > o. 


PROBLEMS 


1. What is the Fourier series expansion of the square sine wave 


~ J=] -1 <x <0 
fe) -| 1 O<x<1 


f(x + 2) = f(x) (periodic condition) 


Graph the first 2, 3, 4 terms of the series to see how it is converging to f(x). 
Also graph the frequency spectrum of f(x). 

2. Show that if we differentiate the Fourier series expansion (11.3) of the 
sawtooth wave term by term, we arrive at an infinite series that clearly does 
not represent the derivative of the sawtooth curve. 

3. Graph the frequency spectrum of the following periodic functions: 

(a) f(x) = sinx 
(b) f(x) = sin x + cos 2x 
(c) f(x) = sinx + cosx + 0.5 sin 3x 

4. What is the Fourier transform F(£) and the frequency spectrum C(é) = 

|F(&)| of the function 


1 -1 <x<1 
mo = {0 elsewhere 
S. Show that the absolute value of the function F(£) = 1/(1 + i£) is |F(£)| = 
Vili + 5. 
HINT First multiply the numerator and denominator by 1 — i£ to get rid of the 
complex number i in the denominator. 
6. Verify the orthogonality properties of sines and cosines on the interval 
[-L, L| 


L 
; : _ JO m+ n 
L sin (max/L) sin (ntx/L) dx = | L mn 


The Fourier Series and Transform 87 


L 
_jJO msn 
[. cos (mmx/L) cos (nmx/L) dx = | L me m 


L 
[. sin (mmx/L) cos (nmx/L) dx =0 allm, n = 1,2,3,... 


OTHER READING 


Partial Differential Equations of Mathematical Physics by Tyn Myint-U. Elsevier, 1973. 
A well-written text with a fairly extensive section on the Fourier series and transform 
(Chapters 5, 11). Most of the important questions dealing with whether a function actually 
has a Fourier series or integral representation, whether the representation can be dif- 
ferentiated term by term or under the integral to get the derivative of the function, and 
so forth, are answered in these chapters. 
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Lesson 12 


The Fourier Transform and Its 
Application to PDEs 


PURPOSE OF LESSON: To illustrate several useful properties of the 


Fourier transform and to show how these properties can be used to solve 


PDEs. In particular, it is shown how the Fourier transform changes dif- 
ferentiation to multiplication, so differential equations change into algebraic 
equations. Also, the idea of the infinite convolution is introduced. 


The Fourier transform of the function f(x) for —o» < x < œ is given by the 
formula 


"n 
(12.1) Ff] = F(&) = Vin imo ei dx 


That is, we start with a function f(x) defined on the real x-axis, substitute it into 
equation (12.1), and arrive at the new function F(€) for ~œ < € « œ. For 
example, Table 12.1 lists some common Fourier transforms. 


TABLE 12.1 Some Common Fourier Transforms 


Function f(x) Fourier Transform F(£) 
2 ew x20 5 
5 fa = |, x <0 F(é) = E 
T 2 


(complex function) 
_ ji -1l<x<l ; 
2 fix) = E elsewhere F(E) = 2 sin § 
v $ 
(real function) 


3. f(x) =e” F(é) -7 e- (2 


(real function) 
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The reader can refer to the tables in the appendix for additional transforms. We 
can see from the examples that the transformed function F(£) may or may not 
be a complex-valued function of £. In the first example, the transformed function 
F(£) contains the complex number i, so we call it a complex-valued function of 
the real variable — (€ ranges from — ^ to o). In other words, the argument & is 
real, but the value of the function is complex. 

The usefulness of the Fourier transform (as with most integral transforms) 
comes from the fact that it changes the operation of differentiation into multi- 
plication; that is, differential equations are changed into algebraic equations. 
There are also a host of other properties that make the Fourier transform a 
useful operational tool; we list a few of the more important ones. 


Useful Properties of the Fourier Transform 
Property 1 (Fourier Transform Pair) 


The Fourier transform of f(x), -œ < x < o, produces a new function F(é) 
defined by the formula 


Fil = FO = cx]. fede ® ds 


and the inverse Fourier transform of F(Ẹ), —o < & < œ will reproduce the 
original function f(x) according to 


1 [ | 
F-E] = ft) = Fe | FPOe at 
For example, 
Sum, [2 1 9 Ven 
Tl-E&E 


See Figure 12.1. 
fix) F(é) fix) 


g ^N g-! 
x t x 
FIGURE 12.1 Graph of a function and its transform. 
Property 2 (Linear Transformation) 


The Fourier transform is a linear transformation; that is 
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Flaf + bg] = a¥lf] + bF¥[g] 


This is easy to see. The reader can spend a few minutes to verify this property, 
which is used over and over again. For example, the Fourier transform of the 
expression 


C ui 
aiu] + 3e 
would be 


l 


E 
* + 1 


]+ 3¥[e->7] 


Property 3 (Transformation of Partial Derivatives) 


When we discuss how derivatives transform, we must distinguish partial deriv- 
atives with respect to various variables. For instance, if the Fourier transform 
transforms the x-variable (the variable of integration in the transform) and if 
the function being transformed is a partial derivative of a function u(x,t) with 
respect to x, then the rules of transformation are 


Flu] = z |. u(x, e~ dx = i&&[u] 


Flu.) = Un(x,Ne-™ dx = -E9u] 


1 | à 
Vat J-= 

On the other hand, if we transform the partial derivative u,(x,t) (and if the 
variable of integration in the transform is x), then the transform is given by 


i ô 

Flu] = Jx |. u(x,t) e “dx = Ffu] 
1 f 9? 

Ffu] = Vin B u,(x, the" dx = E Ffu] 


Property 4 (Convolution Property) 


Every integral transform has what is called a convolution property. The general 
idea is that the transform of a product of two functions f(x)g(x) is not the product 
of the individual transforms; that is, 


Fs) + FIFE] 
However, in transform theory there is something called the convolution f « g 
of two functions that more or less plays the role of the product. What is true 


about this convolution f « g is that 
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(12.2) Alf * g) = FFs] 


So what is this mysterious convolution f « g? It’s given by the formula 


(123) (F* 8) = =| fa - DE dt 


and it can be shown without too much trouble that (12.2) holds. We see from 
the definition of the convolution that given two functions f(x) and g(x), the 
convolution (f * g)(x) is a new function. 


Example of a Convolution of Two Functions 
Given the two functions 


f(x) = x 
g(x)= e^" 


the convolution is given by 


D= = |e e*t 
= x/V2 (a new function) 


We have used the formula 


oc 


[. e`? d£ = Vr 


to arrive at this value. 

The importance of the convolution (12.3) in applications is due to the fact 
that quite often, the final step in solving a PDE boils down to finding the inverse 
transform of some expression that we can interpret as the product of two trans- 
forms ¥[f|¥[g|; that is, we must find 


(12.4) 9 O[fI [gli 


By taking the inverse of each side of (12.2), we arrive at the result 


(12.5) f*g-9 (9f 
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Hence, to find (12.4), all we have to do is find the inverse transform of each 
factor to get f and g and then compute their convolution. We are now in a 
position to work an important problem in PDE theory. 


Solution of an Initial-Value Problem 


Consider the heat flow in an infinite rod where the initial temperature is u(x,0) 
= (x). In other words, we look for the solution to the initial-value problem 
(IVP), sometimes called a Cauchy problem 


(12.6) PDE u, = ou, —c«cx«o Q<t<o 
IC u(x,0) = (x) -o <x <x 


There are three basic steps in solving this problem. 


STEP 4 (Transforming the problem) 

Since the space variable x ranges from — æ to oo, we take tne Fourier transform 
of the PDE and IC with respect to this variable x (the variable of integration 
in the transform is x). Doing this, we get 


Flu) = Ffu] 
F[u(x,0)] = 9[$(x)] 


and using the properties of the Fourier transform, we have 


dU(t) 
(12.7) dt 
U(0) = P(E) (® is the Fourier transform of 6) 


= —a*t?U(t) 


where U(t) = ¥[u(x,t)]. The reader should note here that the function U actually 
depends on both t and the new transformed variable £, but, for simplicity, since 
€ is a constant insofar as the differential equation (12.7) is concerned, we will 
drop the notation and just call U = U(t). 

STEP 2 (Solving the transformed problem) 


Remember the new variable € is nothing more than a constant in this differential 
equation, so the solution to this problem is 


(12.8) U(t) = P(E) e-** 


STEP 3 (Finding the inverse transform) 
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To find the solution u(x,t), we merely compute 


u(x,t) = 9 '[U(&1)] 


F [P(e] 


Here is where the convolution theorem (12.5) comes to the rescue. Using this 
property, we can write 


u(x, t)= F-"[P(E)e- °°] 


FDE Fe] 


(12.9) (x) * | = eem (using tables) 


1 oc 
— (x — £)?/4o?t 
Javi J-a PÈ) € ^ 


We're done; equation (12.9) is the solution to our problem. 
Before stopping, however, let's analyze this result. Note that the integrand 
is made up of two terms 


1. The initial temperature (x) 


1 
2a N/mt 


function or the impulse-response function) 


2. The function G(x,f) = 


e- 0-9" ^ (which is called Green's 


It can be shown that this impulse-response function G(x,t) is the temperature 
response to an initial temperature impulse at x = ¢. In other words, G(x,t) is 
the temperature along the rod at time ¢ due to an initial unit impulse of heat at 
x = & (Figure 12.2). 


G(x, t) looks like what is called the 
normal-distribution curve from statistics 
with time playing the role of the variance 

of the distribution. 


G (x, t) gradually damps out 


G (x, t) for small time 
x 
x-t 


FIGURE 12.2 Impulse response G(x.) from a temperature impulse at x = &. 
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Hence, the interpretation of solution (12.9) is that the initial temperature u(x,0) 
= (x) is decomposed into a continuum of impulses of magnitude ®(é) (at each 
point x = &) and the resulting temperature (£)G(x,1) is found. These resulting 
temperatures are then added (integrated) to obtain solution (12.9). Later, we 
will see that this general idea is known as superposition. 

From a practical point of view, solution (12.9) can often be integrated for 
some particular initial temperature (x). If this integration cannot be carried 
out analytically, the solution can be found at any point (x,t) by numerically 
integrating the integral. 


NOTES 


The major drawback of the Fourier transform is that all functions can not be 
transformed; for example, even simple functions like 


f(x) = constant 
f(x) e 


f(x) = sin x 


cannot be transformed, since the integral 
s [f] = a [ f(x)e ^ * dx 
vV2m J-« 


does not exist. Only functions that damp to zero sufficiently fast as |x| — œ have 
transforms. Also, the Fourier transform could not be used to transform the time 
variable in the previous initial value problem, since 0 « t « ~. 


PROBLEMS 


1. Find the Fourier transform of 


x <0 


mU 2 0<x 


Check your answer by using the tables in the appendix. 
2. Verify that the Fourier and inverse Fourier transforms are linear transforms. 
3. Solve the initial-value problem 


PDE U, = a?u,, —o «x «o 
IC u(x,0) =e"  -oc«xc«o 


by using the Fourier transform. 
4. Verify the properties 
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F[u,]= i& Ffu] 
Flu,.]= -E Ffu] 


HINT Use integration by parts. 
5. Verify that the convolution of two functions f and g can be written as either 


FD Se | fle - Bale) di 


Or 


F x= ee | Os - 8 di 


OTHER READING 


Fourier Series and Orthogonal Functions by H. Davis. Allyn and Bacon, 1963; Dover, 1989. An 
excellent book gives the reader an intuitive as well as rigorous viewpoint of Fourier series and 
transforms. 
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LESSON 13 


The Laplace Transform 


PURPOSE OF LESSON: To introduce the important transform pair 


Lif] = F(s) = f f(e- dt (Laplace transform) 
1 C T ie 


£-([F]-f(t)  — F(se* ds (inverse Laplace transform) 


QT Jc- i 


andillustrate useful properties. The Laplace transform has an advantage over 
the Fourier transform because it contains the damping factor e~“ that allow us 
to transform a wider class of functions. Inasmuch as the transform operates on 
functions defined on [0,o), it is mostly applied to the time variable f. 

After discussing some useful properties of the Laplace transform, we will 
solve an important problem in PDE theory. 


Of all the integral transforms we will study in this book, the Laplace transform 


(13.1) gif] = | fe" dt 


is probably the only one the reader has seen before, since it is a very powerful 
tool for transforming initial-value problems in ODE into algebraic equations. 
Not only is the Laplace transform useful in transforming ODEs into algebraic 
equations, but now we will use the Laplace transform to transform PDEs into 
ODEs. In particular, we will attempt to apply the Laplace transform to any 
variable x, y, z, t, . . . that ranges from 0 to o (although it will generally be 
applied to time). The major difference in applying the Laplace transform to 
PDEs in contrast to ODEs is that now when the original PDE is transformed, 
the new resulting equation will be either a new PDE with one less independent 
variable or else an ODE in one variable. We must then decide how to solve this 
new problem (maybe by another transform, by separation of variables, and so 
on). Before actually solving a very interesting problem, we enumerate some 
useful properties of this transform. | 
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Properties of the Laplace Transform 


Property 1 (Transform Pair) 


The Laplace transform and its inverse are given by 


(13.2) XU] = Fs) = í f(t)e7" dt (Laplace transform) 


L- [F] = f(t) = = | " F(s)*' ds ^ (inverse Laplace transform) 


The Laplace transform has one major advantage over the Fourier transform in 
that the damping factor e~ in the integrand allows us to transform a wider class 
of functions (the factor e in the Fourier transform doesn't do any damping, 
since its absolute value is one). In fact, the exact conditions that insure that a 
function f(t) has a Laplace transform are given by the following theorem: 


Sufficient Conditions to Insure the Existence of a 
Laplace Transform 


If 
1. fis piecewise continuous on the interval 0 < ¢ < A for any positive A 
2. we can find constants M and a such that |f(t)| < Me" for all values of t 
greater than some number T 
then 


the Laplace transform L£[f(t)] = F(s) = f f(t)e^* dt exists for s > a 


We now list a few functions that have Laplace transforms and graph them on 
the s-axis. 


1. f(t) 1 0cr«o [« 1 
(pick M=1 a=0) Fis) = j e Uere 
(see Figure 13.1a) 
fit) F (s) 


fit) » 1 


t 
(a) 
FIGURE 13.1a-13.1c Graphs of a few Laplace transforms. 
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2. ft) e" O<t<o B 
(pick M 2 1 a = 2) EQ) a5 Sue 
(see Figure 13.15) 


F(s) 


fit) 


fit) = e?! 


(b) 


3. f(t) = sin (ot) T 
(pick M - 1 a - 0) MS) = ae 


(see Figure 13.1c) 


fit) Fs) 


f (t) = sin (we) 


(c) 


4. f(t) =e" | (doesn't have a Laplace transform) 


In the definition of the Laplace transform, the variable s is taken to be a real 
variable 0 < s < œ. It is possible, however (often desirable), to extend this 
definition to complex values of s and, in fact, to evaluate the inverse Laplace 
transform 


1 c + fo 


L-YF] = ui ls F(s)e* ds 


We must often resort to contour integration in the complex plane and the theory 
of residues. We won't bother ourselves with this topic here but will use the tables 
in the appendix for finding inverse transforms. 
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Property 2 (Transforms of Partial Derivatives) 


Suppose we have a function u(x,t) of two variables and wish to transform various 
partial derivatives U, Um U, U, .. . . Since the Laplace transform transforms 
the t-variable (variable of integration), the rules of transformation for partial 
derivatives are 


S$€[u] = f u(x,t)e^* dt = sU(x,s) — u(x,0) 

E(u) = f u,(x,t)e * dt = s?U(x,s) — su(x,0) —ux,0) 
‘ Q4, OU 

S$€[u] = f u,(x,t)e-* dt = x05 
d Q4, 8U 

jun] = [ u.(x,s)e^* dt = a2 œs) 


where U(x,s) = S[u(x,t)]. The transform rules for u, and u,, are a result of a 
basic rule in calculus 


{| fey a = | Zena 


while the rules for u, and u, can be proven by using the integration by parts 
formula. 


Property 3 (Convolution Property) 


Convolution plays the same role here as it did in the Fourier transform, but now 
the convolution is defined slightly differently. 


Definition of the Finite Convolution 
The finite convolution of two functions f and g is defined by 
FDO = | fos - 9 ar 
= Í ft - 3809) dr 


(these two integrals are the same). In other words, in the finite convolution, we 
integrate from 0 to t instead of from — o to œ, as we did in the infinite convolution. 
An example of the finite convolution of two functions 
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fo =t 
g(t) =t 


would be 


(f * gX = f a(t — T) dt = fP/6 


As in the case of the infinite convolution, the important property of this new 
convolution is that 


(13.4) Lif * 8) = 3f) Eis] 
or the equivalent formula 
(13.5) Zip Eish =f*g 


This property will allow us to find the inverse Laplace transform of a product 
of two functions (which we interpret as Z[f]Z[g]) by finding the inverses of each 
factor [f] and [g] to get f and g and then finding their convolution. For 


example 
1 t 
gt. | = [sinsa = 1 = cos: 
sS sé +] 0 


Fo) =2 25 AQ oe) £4 8 = sine 


We are now ready to work an important initial-boundary-value problem. 


Heat Conduction in a Semi Infinite Medium 


Consider a large (deep) container of liquid that is insulated on the sides. Suppose 
the liquid has an initial temperature of u, and that the temperature of the air 
above the liquid is zero (some reference temperature). Our goal is to find the 
temperature of the liquid at various depths of the container at different values 
of time. To do so, we must solve the problem 


PDE U, = Uy, O<x<& O<t<a 
(13.6) BC u,(0,t) — u(0) =0 OK<t<x 
IC u(x,0) = W 0cxc«e 


See Figure 13.2. 
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TE out if 4(0, 1) > O 
eat OWS in if u (0, t) <0 


4 


The container is sufficiently 
deep so that the boundary 
conditions at the bottom do 
not affect the solution for 
those values of x of interest 


SS 


N 


FIGURE 13.2 Diagram illustrating the heat-flow problem. 


To solve this problem, we transform the time variable t by means of the Laplace 
transform (conceivably, we could also transform x by means of the Laplace 
transform, since x also ranges from 0 to œ). Transforming our problem, we 
arrive at an ODE in x 


dU 
(13.7) ODE  sU(x)-u, do (x) 0cxc«o 


dU 
BC =-(0) = U(0) 


(we transform the PDE and the BC—not the IC). This is a second-order ODE 
with one BC at x = 0 [for physical reasons, we really have a second, implied 
BC that says U(x) is bounded]. Note that we have dropped the s-notation 
in U(x,s) in favor of the simpler notation U(x), since the differential equation 
in (13.7) depends only on x. 

To solve (13.7), we first find the general solution (homogeneous + a particular 
solution), which is 


u 
U(x) = ce 5* + ce * + = 


Substituting this expression into the BCs of (13.7) allows us to find the constants 


c, and c, (first note that c, = 0 or else the temperature will go to infinity as x 
gets large). Finding c; from the BC at x = 0 gives us the answer for U(x) 


e V5 x 7 
(13.8) U(x) — — Uy | awa T x 


Now for the last step. To find the temperature u(x,t), we compute 


u(x,t) = £-'[U(x,s)] 
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[we now put back s in U(x,s)]. To find this inverse transform, we must resort 
to the tables of inverse Laplace transforms in the appendix; they will give us 


(13.9) u(x,t) = Uy — Uy [erfc(x/2NVt) — erfc (Vt + x/2vt) e**?] 
where 


erfc(x) — 5 [ e~© dé 


is the complementary-error function whose graph is given in Figure 13.3. 


erf (x) = 1 - erfc(x) 


erfc (x) 
x 


FIGURE 13.3 Graphs of the error (erf) and complementary-error (erfc) 
functions. 


If we spend a little time analyzing this equation and graphing it by means of a 
computer with a plotter attachment, we will see that it looks like Figure 13.4. 


u 


Uo - t=0 


B t 20.1 


t = oo 


FIGURE 13.4 Temperatures inside the infinite medium for different values of 
time. 


1. The Laplace transform can also be applied to problems where the PDE is 
nonhomogeneous (in separation of variables, the equation had to be ho- 
mogeneous), but the Laplace transform will generally work only if the equa- 
tion has constant coefficients (in separation of variables, we could have 
variable coefficients). The following table lists the types of problems the 
two methods will handle. 
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TABLE 13.2 Comparison of Laplace Transform and Separation of 


Variables 
Method 
Laplace Separation 
Transform of Variables 

Nonhomogeneous PDE yes no 
Nonhomogeneous BC yes no 
Variable coefficients no yes 
Nonlinear equations no no 
2. The Hankel and Mellin transforms are also used to solve IBVPs and BVPs but differ 

from the Laplace transform in one regard. The Laplace transform converts derivatives 

to multiplication operations by means of a formula like 

Lly'] = s£[y] — y(0) 
whereas the Hankel and Mellin transforms convert differential operators to 
multiplication; for example, the Hankel transform 
Hp] = | PIED) dr 
transforms the differential operator 
/ 1 / 
Hy") + -y'e = -eHpj 

In this way, specific differential equations with variable coefficients (Bessel’s 

equation) can be solved. 
3. 


The Laplace transform (which transforms #) can be interpreted as projecting 
the xt-plane onto the x-axis, and the original BCs, PDE, and IC are trans- 
formed into a new differential equation and BCs. See the following diagram. 


t 


u, (1, t) + hu(1,t) - O 


u(0,t)  O 


a 


u(x, 0) = f(x) 
U(0) = 0 U,U) +hU(1) =0 
2 
sUlx) - fx) = o2 2 
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PROBLEMS 


1. Verify the following formula for the transform of the partial derivative u, 
Llu,(x,t)] = sU(x,s) — u(x,0) 
2. Solve the following initial-value problem by means of the Laplace transform 


PDE U, = QU, —o-«cx«o 0cr«o 
IC u(x,0) = sin x —00 «x <% 


3. Solve the problem 


PDE U, = uy 0<x< 0 0ct«o 
BC u(0,t) = sint O<t<o 
IC u(x0)-0 Os<x<oam 


by means of the Laplace transform (transform t). What is the physical inter- 
pretation of this problem? 
4. Solve the boundary-value problem 


ODE SU =A 0cx«1 
= (0) = 0 

BCs ii 
U(1) = 0 


OTHER READING 


1. A First Course in PDE by H. Weinberger. Ginn and Co., 1965. This text contains 
an extensive section on contour integration, which is the tool used for evaluating the 
inverse Laplace transform. 


2. Almost any beginning text in ODE will contain a chapter on the Laplace transform. 
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LESSON 14 


Duhamel’s Principle 


PURPOSE OF LESSON: To show how the Laplace transform can 


bring out interesting underlying phenomena concerning solutions of dif- 
ferential equations, in particular, by algebraically manipulating the Laplace 


transform of the solution of a PDE, we discover an interesting idea known 
as Duhamel’s principle. This principle has interpretations in ODE, but we 
will illustrate how it works in the context of a specific initial-boundary- 
value problem. 


In addition to providing a powerful tool for solving PDEs, the Laplace transform 
also provides insight into the nature of solutions to physical problems. With the 
help of the Laplace transform, we illustrate a very important and interesting 
concept known as Duhamel’s principle in this lesson. Before getting to this 
principle, however, let's discuss a problem that occurs frequently in engineering. 


Heat Flow within a Rod with Temperature Fixed on the 
Boundaries 


Quite often, it is important to find the temperature inside a medium due to time- 
varying boundary conditions. For example, consider an insulated rod with tem- 
perature specified as f(t) on the right end 


PDE U, = Uy. O<x<1 O<t<o 
0,4) = 0 
14.1 BCs u(0, 0ct«o 
Un PY = f(t) 


IC u(x,0) = 0 0xxxl 


See Figure 14.1. 


ii Í i MEE Ut di 
A: 


Initial temperature = 0 


FIGURE 14.1. Time-varying boundary conditions. 
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We may think that the solution to problem (14.1) can be easily found once 
we know the solution to the simpler version (constant temperature on the 
boundaries) 


0<x< 1 0<t<o 


(14.2) BCs ae L1 «iem 


In fact, if we solve problems (14.1) and (14.2) side by side by the Laplace 
transform, we will see a striking result (Duhamel's principle) that will give us 
the solution to (14.1) in terms of the solution of (14.2). 

So, solving (14.1) and (14.2) at the same time, we have 


Easy Problem (14.2) Hard Problem (14.1) 
(constant BC) (time-varying BC) 
Transform problem (14.2) by the Transform problem (14.1) by the 
Laplace transform Laplace transform 


PW — sW(x) = 0 CU — sU(x) = 0 
dx? dx? 
W(0) = 0 U(0) = 0 
W(1) = 1/s U(1) = F(s) 
Solve the ODE Solve the ODE 
i i 
1 | sinh(x Vs) sinh(x Vs) 
W(x,s) = - | —É 5) = F(s) | A 
wem ps | oro e) | sinh(V/s) 
Find the inverse transform Don’t invert yet—first multiply 
and divide by s 
J i 
w(x,t) = 
2~(-1)" 
d NA LLL g-—(nm)yt 
x 2 3 sin (nx) 


(solution to the constant BC problem) 


sinh(x V/s) | | 


U(x,s) = F(s) (| reva 
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Easy Problem (14.2) (Cont.) Hard Problem (14.1) (Cont.) 
(constant BC) (time-varying BC) 


Using the relationship 


L[w,] = sW — w(x,0) 


we have 


U(x,s) = F(s) £[w,] 


Hence 


= f f(t) w(x,t— 7) dt 
(or by integration by parts) 
= | w(x,t—7) f'(t) dt + 
f(O)w(x, 0) 
(solution to the time-varying problem 


in terms of the solution of the constant 
BC problem) - 


In other words, we have found the solution u(x,t) to the time-varying problem 
in terms of the solution to the easy problem (constant BCs); that is, 


(14.3) u(x,t) = { w(x,t — T)f(1) dt 
= f w(x,t — 1)f' (x) dt + f(0)w(x,t) 


Equations (14.3) are known as Duhamel's principle. We can now take the so- 
lution w(x,t) to the constant BC problem 


2 i —1 £ 2 . 
w(x,t) =x + » | E e~("™" sin (nmx) 


nzi 


and substitute it into equation (14.3) to obtain the solution to the time-varying 
problem [we must use the second equation in (14.3), since if we differentiate 
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the infinite series representation for w(x,t) term by term (with respect to /), it 
results in a divergent series]. 
There is another aspect of Duhamel's formulas that makes them very useful. 


The Importance of Duhamel’s Principle 


In the problem just discussed, we were able to solve the easy problem with 
constant BCs, so we used Duhamel’s formulas (14.3) to obtain the solution to 
the time-varying BCs. Quite often, however, even the easy problem (constant 
BCs) cannot be solved analytically. What we can do, however, is observe the 
solution experimentally; in other words, we can rig a device that has constant 
BCs and experimentally measure the response. We can then use Duhamel’s 
principle to find the solution for any time-varying BC. In fact, we have only to 
observe the response w(x,t) to the constant BC problem once. When we have 
this data, we can then solve the problem with arbitrary BC f(t) by substituting 
into Duhamel's formulas (14.3). 


NOTES 


There is another interesting version of Duhamel's principle that gives the answer 
to the problem 


PDE U, = U,, 0cx«1 0cr«o 
0,) = 0 
14.4 BCs u(0, 0cr«o 
Mn) EM = f(t) 


IC u(x,0) = 0 0x1 
in terms of the solution w(x,t) of the alternative simple problem 
PDE W, = Wx O<x<1 0cr«o 


w(0,t) = 0 
w(1,t) = &(r) 


IC w(x0)20 Osx<l 


(14.5) BCs | (temperature impulse at t = 0 


Knowing this formula, which is 
(14.6) u(x,t) = Í w(x,t — T)f(T) dt 
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allows us to find the temperature response u(x,t) to an arbitrary boundary tem- 
perature f(t) once we have carried out an experiment to determine the temper- 
ature response w(x,t) from an impulse temperature. 


PROBLEMS 


1. Prove the Duhamel principle (14.6) by transforming both problems (14.4) 
and (14.5) and using an argument similar to the one for finding (14.3) in the 
lesson. 


HINT The Laplace transform of the impulse function 8(t) is £[8(t)] = 1. 


2. Show that the partial derivative w, of 


w(x,t) — x * — 
Tn-1 


: `” (-D e^ 07 sin (nmx) 
n 
diverges for all x if we differentiate the series term by term. 

3. Suppose we have a metal rod (laterally insulated) and we supply an initial 
impulse of heat at the right-hand side (the left-hand side is fixed at zero). 
Suppose the initial temperature of the rod is zero (some reference temper- 
ature) and the temperature at the midpoint x — 0.5 is measured at various 
values of time, so that we have the following table: 


Values of Time Midpoint Temperature 
ti Wi 
t, = 3t, W, 
t, = nt, W, 


Using this data, how could we approximate the temperature response at the 
point u(0.5, ¢,) due to the BCs 


(a) u(1,t) = sint 
(b) u(1,0) = f(t) (arbitrary f(t)) 


4. Using Duhamel’s principle, what is the solution of the IBVP 


PDE U, = QU, 0<x<1 0ct«o 
u(0,t) = 0 
Bos EM = sint en 


IC u(x0)20 Osxl 
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OTHER READING 
1. Differential Equations by C. Wylie. McGraw-Hill, 1979. Duhamel’s principle is dis- 
cussed in conjunction with problems in ODE in Chapter 6 of this text. 


2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Mac- 
millan, 1963; Dover, 1990. An excellent source of all kinds of applied problems; the Duhamel 


principle is discussed on page 261. 
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Lesson 45 


The Convection Term uy, in the 
Diffusion Problems 


PURPOSE OF LESSON: To show how the term u, in the diffusion 


equation 


u, =.Du,, — Vu, 


\ 


Diffusion Convection 
term term 


represents the phenomenon of convection. Phenomena described by this 
convection-diffusion equation exhibit both diffusion and convection prop- 
erties and are common in many situations. How much diffusion and con- 
vection takes place depends on the relative size of the two coefficients D 
and V. 

Inasmuch as the convection of a substance represents material moving 
with the medium, it is possible to pick a moving coordinate system that 
moves with the medium. In this way, the convection term is eliminated 
and the equation can be solved in terms of the moving coordinate and then 
transformed back into the original variable x. 


So far, we have been concerned with heat flow (or diffusion of some kind) in 
a one-dimensional domain. Suppose now we consider the problem of finding 
the concentration of a substance upwards from the surface of the earth where 
the substance both diffuses through the air and is carried upward (convected) 
by moving currents (moving with velocity V). Clearly, it is possible for the 
convection of the substance to contribute more of a movement in the substance 
than the diffusion itself. (It would depend on the relative size of the diffusion 
coefficient and the velocity of the air.) Diffusion is mixing the substance through 
the air, while convection is the movement of the substance by means of the air 
(the movement of the medium); in any case, it is our purpose here to solve the 
diffusion-convection equation 


u, = Du,, — Vu 


x 
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and to show how it is derived. 
To verify this equation for a concentration u(x,t) of a substance, we use two 
basic facts 
1. Flux due to convection 
The flux of material (from left to right) across a point due to convection 
is given by Vu(x,t), where V is the velocity of the medium (cm/sec) and 
u(x,t) is the linear concentration (g/cm) (Figure 15.1). 


FIGURE 15.4 Amount of material across X (per second) due to convection 
is Vu(x,f). 


"e um em 


2. Flux due to diffusion 
The flux of material (from left to right) across a point x due to diffusion 
is given by — Du,(x,t), where D is the diffusion coefficient. 
If we substitute these two expressions into the conservation equation in Lesson 
4, we can prove that the basic PDE is 


u, = Du,, — Vu 


x 


To get an idea of what solutions look like or how they behave with the convection 
term included, let’s first work a problem that is pure convection (the diffusion 
term is zero). A typical problem would be dumping a substance into a clean 
river (moving with velocity V) and observing the concentration of the substance 
downstream. For example, if x measures the distance downstream from where 
the substance is added and if the substance does not diffuse with the running 
water, then the concentration of the substance u(x,t) can be found by solving 
the following mathematical model: 


PDE u, = —Vu 


(15.1) BC u(0,t) = P <——— Constant input of the substance 
IC u(x,0) = 0 <——— Initially a clean river 


0cx«o 0crt«o 


This problem is illustrated in Figure 15.2. 


t 


P 


u, t Vu, - 0 


(First-order convection equation) 


u (0, t) 


u(x,0)20 


FIGURE 15.2 Pure convection problem. 
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Before solving this problem, we should think a little about what the solution 
should be. It's obvious that the pollutant (substance in the river) will initially 
be zero, but once it is added at a constant rate at x — 0, it will move downstream 
with velocity V. To see this mathematically, let's solve (15.1). Since it is a linear 
PDE with linear BCs, we should think in terms of separation of variables and 
integral transforms; however, since the x-variable is unbounded, separation of 
variables is out. Let's use the Laplace transform on t. 


Laplace Transform Solution to the Convection Problem 


The convection problem (15.1) can be replaced by 


dU 


sU(x) = der 


0cxc«o 


U(0) = 


ma |My 


by using the Laplace transform 
U(x) = | u(x,t)e^* dt 
Solving this very simple initial-value problem, we get 
U(x) = =e 


Looking up the inverse transform in the tables, we see 
u(x,t) = £-'[U] = PH(t — x/V) 
where H(£) is the Heaviside function (step function) 


no-i i 


Hence, the solution of our problem is just 


0 t<x/V 
Uds e t2 x/V 


This was pretty simple; certainly, it isn't any more complicated than dumping 
something on a conveyor belt and watching it move along. It does, however, 
become more interesting when the solute (pollutant) diffuses with the medium. 
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— 


u(x, 0) =0 


FIGURE 15.3 Pure convection wave. 


To see what happens when a moving wave diffuses, we solve the following 
problem: 


(15.2) PDE u, = Du,, — Vu, —o«x-«o 
IC u(x,0) = 1 — H(x) —o«x«o 


where, as usual, H(x) is the Heaviside function. The initial concentration is 
shown in Figure 15.4. 


FIGURE 15.4 Initial condition for the diffusion-convection equation. 


Note that in the new problem (15.2), we have moved the boundary to — (we 
now have an initial-value problem), so that it doesn't confuse the real issue of 
measuring the relative effects of D versus V (just a technicality). To solve (15.2), 
we could use the Laplace transform on t or the Fourier transform on x; however, 
in this case, there is another alternative that is very interesting. That is, instead 
of measuring the concentration u(x,t) as a function of x, we introduce a new 
coordinate €, which moves along the x-axis with velocity V. In other. words, 
instead of placing our coordinate system along the bank of the river (so to 
speak), we now place our coordinate system so that it moves with the wave front 
(of course, now when we .have diffusion in addition to convection, we won't 
have a sharp wave front). Mathematically this says that we change our space 
coordinate x to £ = x — Vt. It's now clear that 


when & = 0 we are on the wave front 
when é = 1 we are one unit ahead of the front 
when &£ = -1 we are one unit behind the front 
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So our goal is to transform the initial-value problem (IVP) 


PDE u, = Du,, — Vu, —o«x«o 
IC u(x,0) = 1 — H(x) -o <x <% 


into a new one in the moving coordinate system, solve it, and then transform 
back to get the solution in terms of the original coordinates (x,t). To begin, we 
make what is called a change of variables (change of independent variables). In 
place of the old coordinates (x,t), we introduce new ones (£,7) 


£-x-— Vt 


T=! 


The reader should note that 7 is the same as t, but it is less confusing if we give 
it a new name. To rewrite the PDE in terms of (£,7), we use the chain rule 


uU, = ub, + ut, = — Vu + u, 
U, = ub, = Uu 
Ure = (Uz), = ug£, = ug 
Using functional diagrams, as in Figure 15.5, makes these chain-rule arguments 
clearer. 


(u, ug) 


x t 
FIGURE 15.5 Diagram illustrating functional dependence of variables. 
The diagram in Figure 15.5 is useful for computing the partial derivatives of u, u; 
with respect to x and t, since it shows exactly how u and u, depend, in general, 
on € and 7 and that & depends, in turn, on both x and t. The variable 7, on the 
other hand, depends only on t. 


So much for the transformation. We now substitute our computed u, u,, and 
u,, into the PDE to get 


OI 
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u, = Dug 
Hence, our new IVP in terms of ¢ and 1 is 


PDE u, = Dug -o <<% 
IC u(é,0) = 1 — H(ë) —% < <% 


(Note that = x when t = 0, so our ICs are both the same.) This problem has 


already been solved in Lesson 12 by the Fourier transform and has the solution 


1 d : 
u(t) = 37 Dm |. e(B)e & 9^» dB 


where (8) is the initial condition. Hence, in our case, we have 


0 


1 
ub) = SDA | 


e~ 6- BD: dg 


By letting 
;. _ -B es dul 
B = 2V Dr pe 2V Ds ap 


we get the interesting result 


(15.3) u(&r = E f e-P 4| 
WB: 


The graph of this function is plotted for various values of t in Figure 15.6. 


u 


The larger the diffusion coefficient, 
the faster it diffuses to the steady 
state u - 1/2 


0 
FIGURE 15.6 Simple diffusion from high to low concentrations. 
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Finally, to get the solution of our problem in terms of the coordinates x and t, 
we substitute 


= x — Vt 


T= 


into equation (15.3) to get 


(15.4) u(x,t) = 


This is the solution of our diffusion-convection problem (15.2), and it is really 
very easy to interpret; it’s just a moving version of Figure 15.6. In other words, 
depending on the relative size of D (diffusion coefficient) and V (velocity of the 
stream), the solution moves to the right with velocity V while, at the same time, 
the leading edge is diffusing at a rate defined by D (Figure 15.7 shows the break 
up of the leading edge). 


FIGURE 15.7  Diffusion-convection solution moving and diffusing at the same 
time. 


NOTES 


Changing coordinates is a very important technique in PDEs. By looking at 
physical systems with different coordinates, the equations are sometimes sim- 
plified. 


PROBLEMS 


1. Solve the initial-value problem 


u, = Uu, — 2u, —-x<x<x O<t<x 
u(x,0) = sin x -c <y < 
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Solve the following diffusion-convection problem by making a transforma- 
tion as shown in Lesson 8: 


U, = U, — 2u, —00 « x « o 0«crt«o 
u(x,0) = e'sinx -o «x«o 


What is the solution of the following convection problem: 


—00 « x <L 0-cr«o 


Check your answer. 
Solve 


u, — Du,, — Vu, -o <y <% 0<t<o 
u(x,0) = e-* —% <x <% 


Does the solution check? What does the solution look like for various values 
of time? 

HINT Note that our transformation to moving coordinates allows us to 
essentially neglect the term Vu, in the PDE. After solving the new problem, 


PDE u, = Dug -0 < ë< œ% O0<T< 
IC (£0) =e" -w<&E< om 


we merely set € = x — Vtand * = t. In this particular problem, it is possible 
to evaluate the integral 


B? g-(6-8)A4D: dg 


n” 
62 = S79 |e 


This is the Fourier transform solution from Lesson 12. It may be more 
convenient for the reader to rewrite this integrand and then look it up in 
a table of integrals. 
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PART 3 


Hyoerbolic-Type 
Problems 


LESSON 16 


The One-Dimensional Wave 
Equation (Hyperbolic Equations} 


PURPOSE OF LESSON: To introduce the one-dimensional wave 
equation 
uU, = ou 


xx 


and show how it describes the motion of a vibrating string. It is also shown 


how this equation is derived as a result of Newton's equations of motion. 
In addition, a few other variations of thé wave equation, such as 


= gu, + F(x,t) 
a’u,, — Bu, — Mu + F(x,t) 


are discussed. 


So far, we have been concerned with physical phenomenon described by one- 
dimensional parabolic equations (diffusion problems). We will now begin to 
study the second major class of PDEs, hyperbolic equations. We start by studying 
the one-dimensional wave equation, which describes (among other things) the 
transverse vibrations of a string. 


Vibrating-String Problem 


We consider the small vibrations of a string that is fastened at each end. We 
assume the string is stretched tightly, made of a homogeneous material, unaf- 
fected by gravity, and that the vibrations take place in a plane (Figure 16.1). 


u 


u (x, t) = displacement of the string 
from equilibrium 


0 L 


FIGURE 1641 Transverse vibrations of a string. 
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To mathematically describe the vibrations of this string, we consider all the 
forces acting on a small section of the string (Figure 16.2). 


T sin 053 Tu, (x + Ax, nt 


T sin 6, = Tu, (x, t) 


x 
x +t Ax 


FIGURE 16.2 Small segment (x, x + Ax) of the vibrating string. 


Essentially, the wave equation is nothizg more than Newton's equation of motion 
applied to the string (the change in momentum nu, of a small string segment 
is equal to the applied forces). Looking at Figure 16.1, we can imagine several 
forces acting on the string in the direction perpendicular to the x-axis. 
The most important forces are 
1. Net force due to the tension of the string (a*u,,) 
The tension component has a net transverse force on the string segment 
of 


Tension component = T sin 0, — T sin 0, 
T [u,(x + Ax,t) — u,(x,t)] 


IR 


2. External force F(x,t) 
An external force F(x,t) may be applied along the string at any value of 
x and t; some examples would be, 
(a) gravity F(x,t) = —mg 
(b) impulses along the string at different values of time 
(c) in the two-dimensional wave equation (which we will study later) 
that describes the vibrating drumhead, a force could be applied 
by sound waves impinging on the surface of the membrane. 
3. Frictional force against the string ( — Bu,) 
If the string is vibrating in a medium that offers a resistance to the string’s 
velocity u,, then this resistance force is — Bu, 
4. Restoring force ( — yu) 
This is a force that is directed opposite to the displacement of the string. 
If the displacement u is positive (above the x-axis), then the force is 
negative (downward) 
If we now apply Newton's equation of motion 
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mu, = applied forces to the segment (x,x + Ax) 


to the small segment of string, we have 
Axpu, = Tlu,(x + Ax,t) — u,(x,t)]  AxF(x,t) — AxBufx,t) — Axvyu(x,t) 


where p is the density of the string. By dividing each side of the equation by Ax 
and letting Ax — 0, we have the well-known telephone equation 


(16.1) u, = o?u,, — Bu, — yu + F(x,t) 


which is the equation we wanted to derive [note that B, y, and F(x,t) in equation 
(16.1) should be divided by p, but we will relabel them as B, y, and F for 
simplicity]. We will now present an intuitive interpretation of the simple wave 
equation. 


(16.2) Un = QU, 


intuitive interpretation of the Wave Equation 


The reader may ask why we would expect an equation like (16.2) to describe 
something like the vibration of a violin string. To answer this, we must under- 
stand that the expression u, represents the vertical acceleration of the string at 
a point x. Hence, equation (16.2) can be interpreted as saying that the accel- 
eration of each point of the string is due to the tension in the string and that the 
larger the concavity u,,, the stronger the force (the proportionality constant is 
a? = T/p). See Figure 16.3. 


Uyy SO > uy, «0 


(String accelerating downward) 


Inflection point Ux 0> uy, > 0 
(String accelerating upward) 


FIGURE 16.3 Interpretation of the wave equation u, = o?u,,. 


NOTES 


1. The wave equation u, = a*u,, also describes longitudinal and torsional 
vibrations of a rod. In these vibrations, the displacement is parallel to the 
rod (like hitting the end of the rod with a hammer), and u(x,t) stands for 
the longitudinal displacement of a point on the rod from its equilibrium 
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position. The PDE can be derived in more or less the same way as in the 
transverse-vibrations case and it is given by 

Us et ku,, 
where k is a physical parameter known as Young's modulus (which is a 
measure of the elasticity of the rod). Materials that have large Young's 
moduli vibrate rapidly; sound waves also constitute longitudinal waves. 


2. If the vibrating string had a variable density p(x), then the wave equation 
would be: 


u = —[o(xu,] 


In other words, the PDE would have variable coefficients. 
3. Since the wave equation u,, = ou,, contains a second-order time derivative 
u,,, it requires two initial conditions 


u(x,0) = f(x) (initial position of the string) 
u,(x,0) = g(x) (initial velocity of the string) 


in order to uniquely define the solution for t > 0. This is in contrast to the 
heat equation, where only one IC was required. 

4. Another situation that can be described by the one-dimensional wave equa- 
tion is an electric current along a wire. With the help of Kirchhoff's laws, 
we can arrive at a system of two first-order PDEs 


(16.3) i, + Cv, + Gv = 0 
v, + Li, + Ri = 0 
where 
x = location along the wire 
[ = time 


i — current along the wire 

V (x,t) = potential along the wire 

C = capacitance/unit length of wire 

G - leakage conductance/unit length of wire 
R - resistance/unit length of wire 

L = self-inductance/unit length of wire 


Equations (16.3) are the well-known transmission-line equations and are not 
generally left in this form, but are further manipulated. This is, by differ- 
entiating the first equation with respect to x and the second with respect to 
t, multiplying by C, and then subtracting, we have 
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i. + Gv, — CLi, — CRi, = 0 
Now, by using the second equation in (16.3) 
yv, = — Li, — Ri 
we get 


(16.4) i, CLi, + (CR + GL)i, + GRi 


This is called the transmission-line equation for the current i and is a second- 


order hyperbolic equation (unless C or L are zero, in which case it becomes 
a parabolic equation). 


The voltage also has its own equation, which is 
(16.5) Vu = CLv, + (CR + GL), + GRv 
Note, too, if G = R = 0, we have the equations 


EE 2 
(16.6) m A Va — a? = 1/CL 


PROBLEMS 


1. Derive the transmission-line equation (16.5) for v from the system of two 


first-order equations (16.3). 
From your knowledge of the various terms of the wave equation, what would 


you expect the solution of the following problem to look like for various 
values of time? 


2: 


PDE Un = Uu — U, 0<x<1 0<t< 
u(0,t) = 0 
BCs fe — 0 0cr«o 


0zxxxl1 


(x,0) = sin (x) 
ICs n iie 


3. What would the solution 


of the following problem look like for various 
values of time? 


PDE Un, = us, 0cxc«1 


u(0,t) = 0 
pe pM — sint Ds 
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u(x,0) = 0 
ICs E7 = 0 Osx<xl 


What is the physical interpretation of this problem? 
4. How many solutions of u, = u,, can you find by looking for solutions of the 
form 


u(x,t) = e»** 


Is the sum of two solutions a solution? 


OTHER READING 


Elementary Partial Differential Equations by P. Berg and J. McGregor. Holden-Day, 
1966. An excellent reference text. 
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Lesson 17 


The D'Alembert Solution of the 
Wave Equation 


PURPOSE OF LESSON: To find the solution of the initial-value 
problem 
u, = CU, —00 « x « 0 0<t<o 


c [6578 ca ce 


This problem (which has no boundaries) describes the motion of an infinite 
string with given initial conditions and was solved in about 1750 by the French 
mathematician D’Alembert. This so-called D’Alembert solution 


u(x,t) = ; |j — ct) + f(x + | + l[. g(£&) dé 


is easy to compute once we have the two initial conditions. In addition, this 
solution has interesting interpretations in terms of moving wave motion. 


If the reader recalls the parabolic case, we started solving diffusion problems 
when the space variable was bounded (by separation of variables) and then went 
on to solve the unbounded case (where — ^ < x < o) by the Fourier transform. 
In the hyperbolic case (wave problem), we will do the opposite. We start by 
solving the one-dimensional wave equation in free space. That is, the pure initial- 
value problem 


PDE us, = Cu, —o <x <% 0ct«o 
me (x,0) = f(x) 
ICs MUI E NA —o-cxc«o 
lr = g(x) 


We could solve this problem by using the Fourier transform (transforming x) 
or the Laplace transform (transforming t), but we will introduce yet a new 
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technique (canonical coordinates), which will introduce the reader to several 
new and exciting ideas; we now solve problem (17.1). This technique is basically 
the same as the moving-coordinate method of Lesson 15. 


D’Alembert’s Solution to the One-Dimensional Wave 
Equation 


We solve problem (17.1) by breaking it into steps. 
STEP 1 [Replacing (x,t) by new canonical coordinates (&,w)] 


To solve (17.1), it turns out that if we replace the two independent variables x 
and t by the two new space-time coordinates (&,n) 


E=x+ct 
n=zx-—ct 
the PDE 
u, = CUu, 
is transformed into 
uu, = 0 


This is really very easy to see, since a simple application of the chain rule gives 


=u, + U, 

u, = cC(u, — u,) 

Wu = Ug + 2U + Uym 
Un = C(ug — 2Uz,+ Una) 


(17.2) 


and, hence, substituting the expressions for u,, and u,, into the wave equation 
gives 


This completes step 1. 


STEP 2 (Solving the transformed equations) 

The idea now is that this new equation can be solved easily by two straightforward 
integrations (first with respect to & and then with respect to n). Integration with 
respect to £ gives 
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un) = (n) (an arbitrary function of n) 
and, secondly, integration with respect to vj gives 


u(£,m) = (n) + w(£) 


where P(x) is the antiderivative of (n), and W(&) is any function of &. In other 
words, we can say that the general solution (all solutions) of 


1S 
(17.3) u(é,n) = (m) + w(£) 


where ó(n), W(&) are arbitrary functions of y and £, respectively. For example, 
the reader can check that the functions 


ulk, n) = sin q + & 
u(é,n) = 1/ + tan £ 
u(E,n) = n? + e 


are all solutions of u,,, = 0. This completes step 2. 


STEP 3. (transforming back to the original coordinates x and t) 
To find the general solution (all solutions) to u, = c?u,,, we substitute 


E - x tct 
=x- ct 
into 
u(n) = (n) + (E) 
to get 
(17.4) u(x,t) = d(x — ct) + y(x + ct) 


This is the general solution of the wave equation, and it is interesting in that it 
physically represents the sum of any two moving waves, each moving in opposite 
directions with velocity c. For example, the functions 


u(x,t) = sin (x — ct) (one right-moving wave) 
u(x,t) = (x + ct) (one left-moving wave) 
u(x,t) = sin (x — ct) + (x + ct)? (two oppositely moving waves) 
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would be three typical solutions. 
Figure 17.1 illustrates the simple (right) moving wave 


u(x,t) = e 0-9 


Velocity = c 


t=0 t=1/e t=2/c 


0 | 1 2 
FIGURE 17.1 Right-moving wave u(x, f) = e-* - of 


STEP 4 (Substituting the general solution into the ICs) 

If the reader remembers ODE theory, the general strategy for solving initial- 
value problems was to find the general solution and then substitute this equation 
into the ICs in order to find the arbitrary constants. In our current problem, we 
have an analogous situation; in order to solve our initial-value problem, we first 
found the general solution 


u(x,t) = d(x — ct) + W(x + ct) 


to the PDE (which contains two arbitrary functions) and now substitute this 
expression into the two ICs 


u(x,0) = f(x) 
u(x,0) = g(x) 


to find the arbitrary functions o, y. Doing this, we get 


(x) + W(x) = f(x) 
(17.5) Eo + cV (x) im 


We now integrate the second equation of (17.5) to get a new expression in $(x) 
and p(x) [and then algebraically solve for (x) and (x) from the two equations]. 

Carrying out this integration on the second equation of (17.5) by integrating 
from x, to x, we get 


(17.6) -c&(x) + cu) = | &( d + K 
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and so if we algebraically solve for (x) and (x) from the first equation of 
(17.5) and (17.6), we have 


1 1f 
- 6G)» 1f) - x | ate dt 


v= 10) i [ s dt 


and, hence, the solution to our problem (17.1) is 


x ct 


(17.8) u(x,t) — = Uf — ct) + f(x + ct)] + > | : g(£) dé 


xr-—c 


This is what we were aiming for, and it is called the D'Alembert solution to 
(17.1). The reader can play around with the limits on the integral to verify for 
himself or herself that they come out to x — ct and x + ct; this completes the 
problem. 

Before we complete the lesson, however, we present a few examples to show 
how the D'Alembert solution is applied to specific problems. 


Examples of the D'Alembert Solution 


1. Motion of an Initial Sine Wave 


Consider the initial conditions 


u(x,0) = sin x 
u(x,0) = 0 


The initial sine wave would have the solution 


u(x,t) = > [sin (x — ct) + sin (x + ct)] 


This can be interpreted as dividing the initial shape u(x,0) = sin x into two equal 
parts 


and then adding the two resultant waves as one moves to the left and the other 
to the right (each with velocity c). The reader might try to imagine the resulting 
wave form. 


The D'Alembert Solution of the Wave Equation 133 


2. Motion of a Simple Square Wave 


In this case, if we start with the initial conditions 


wos ciere 
'^ — |O everywhere else 
u(x,0) = 0 


and then split the initial wave into two half waves and let each move in an 
opposite direction, we arrive at the wave motion shown in Figure 17.2. 


u 
LL x 
-1 1 
u 
at. | 
x 
-1 1 
u 
-—— = — 
LX 
-1 1 
u 


-1 1 


FIGURE 17.2 Initial wave decomposed into two traveling waves. 


3. Initial Velocity Given 


Suppose now the initial position of the string is at equilibrium and we impose 
an initial velocity (as in a piano string) of sin x 


u(x,0) = 0 
u,(x,0) = sin x 


Here, the solution would be 
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x+ct 


> o sin & dé 


u(x,t) 


1 
- [cos (x + ct) — cos (x — ct)] 


which represents the sum of two moving cosine waves. The reader should ask 
himself or herself if this solution is reasonable. 


This completes Lesson 17; in Lesson 18, we show how the D'Alembert so- 


lution can be used to draw useful interpretations in the xt-plane. 


NOTES 


l. 


Note that a second-order PDE has two arbitrary functions in its general 
solution, whereas the general solution of a second-order ODE has two 
arbitrary constants. In other words, there are more solutions to a PDE than 
to an ODE. 

The general technique of changing coordinate systems in a PDE in order 
to find a simpler equation is common in PDE theory. The new coordinates 
(£m) in this problem are known as canonical coordinates, and we will discuss 
them further in later lessons, especially when we study hyperbolic problems. 
The strategy of finding the general solution to a PDE and then substituting 
it into the boundary and initial conditions is not a common technique in 
solving PDEs. The solution discussed in this lesson is the only one that 
utilizes this strategy. Usually, we cannot find the general solution to the 
PDE, and even if we could, it is generally too complicated to substitute it 
into the side conditions. 


PROBLEMS 


Verify that the general D'Alembert solution (17.8) satisfies the initial-value 
problem (17.1). 
Substitute (17.7) into the general solution 


u(x,t) = d(x — ct) + w(x + ct) 


to get the D’Alembert solution. 
What is the solution to the initial-value problem 


—-x<y<c ox 0O<t<ax 


ICs bor ET —o <x < 


What does the solution look like for various values of time? 
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4. What is the solution of the initial-value problem: 


u, = U,, —o « x «oo 0<t<o 
u(x,0) = T 
—oo«x«oo 
as pt = xe i 


Graph the solution u(x,t) for various values of time. 


5. Algebraically solve for $(x) and (x) from the first equation in (17.5) and 
(17.6) to arrive at (17.7). 
OTHER READING 


Advanced Mathematics for Engineers by C. Wylie. McGraw-Hill, 1958. A readable pres- 
entation of some of the elementary ideas on PDEs. 
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ussoN 18 


More on the D'Alembert Solution 


PURPOSE OF LESSON: To illustrate how the D'Alembert solution 


can be used to find the wave motion of a semi-infinite-string problem 


PDE Hu, = Cu, 0cx«o 0cr«o 
BC u(0,t) = 0 0ct«o 


(5,0) = f) "— 
i nee -gu e 


In addition, the D'Alembert solution is interpreted in the xt-plane. 


In the previous lesson, we found that the expression 


x tct 


081) — wet) = Fe e) + fe ee +s Oak 


x —ct 


describes the displacement u of an infinite string in terms of its initial displace- 
ment u(x,0) = f(x) and velocity u,(x,0) = g(x). This lesson will show the reader 
some interesting interpretations of this equation in the xt-plane (space-time 
plane) and how the equation can be modified to find the solution of the vibrating 
semi-infinite string. 

We start with our interpretation of (18.1) in the xi-plane. 


The Space-Time Interpretation of D'Alembert's Solution 


We proved in the last lesson the solution of the pure initial-value problem 


PDE uU, = Cu, —o «x « o 0Üct«o 
(18.2) (0) 
u(x,0) = f(x) B 
"e a -g 075777 
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is given by 


x-rct 


uli = EE- en + fece eo te] a dt 


x-—c 


We now present an interpretation of this solution in the xt-plane looking at two 
specific cases. 


CASE 1 (Initial position given; initial velocity zero) 
Suppose the string has initial conditions 


u(x,0) = f(x) 
u,(x,0) = 0 


Here, the D’Alembert solution is 
1 
u(x,t) = 5 Vx — ct) + f(x + ct)] 


and the solution u at a point (X,f)) can be interpreted via Figure 18.1 as being 
the average of the initial displacement f(x) at the points (x) — cto, 0) and (x, 
+ ct), 0) found by backtracking along the lines 


X — ct = xg — cte 


characteristic curves 
X + ct = xg + ct, ( ) 


u (xo, to) depends on the initial 
displacement at two points 


x + ct = Xg t cto 


(X i Ctg, 0) (xo + Clo, 0) 


FIGURE 18.14 Interpretation of u(x, f) = £ [fx — cf) + f(x + cH] in the 
xt-plane. 


For example, using this interpretation, the initial-value problem 
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PDE Un = Cu, —o «x«o 0ct«o 


(18.3) 1 —1«x«1 
u(x,0) = 
ICs 0 everywhere else 


u(x,0) = 0 


would give us the solution in the xr-plane shown in Figure 18.2. 


Front edge of 
left-moving wave 


1 0 1 


FIGURE 18.2 Solution of the initial-value problem (18.1) in the xf-plane. 


Figure 18.2 is the xt-plane version of the solution graphed in Figure 17.2 in the 
previous lesson. 

We now interpret the D'Alembert solution when the initial position is zero, 
but the velocity is arbitrary. 


CASE 2 (Initial displacement zero; velocity arbitrary) 
Consider now the IC 


u(x,0) = 0 
u(x,0) = g(x) 
Here, the solution is 


1 
ws) = 2] . gle) dt 


and, hence, the solution u at (x,,1) can be interpreted as integrating the initial 
velocity between xy — ct, and x, + ct, on the initial line t = 0 (Figure 18.3). 
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x -ct = Xo -cto x + ct = xg + cto 


(xo - cto, 0) (xg + cto, 0) 
FIGURE 18.3 Interpretation of initial velocity in the x+plane. 
Again, using this interpretation, the solution to the initial-value problem 
-o « x « o 0cr«o 
(18.4) 
u(x,0) = ]1 -1«x«1 
0 everywhere else 


has a solution in the xt-plane illustrated in Figure 18.4. 


t 


Region 1 Region 2 Region 3 Region 4 Region 5 
[| 


FIGURE 18.4 Solution to problem (18.4) in the x?-plane. 


Problem 18.4 corresponds to imposing an initial impulse (velocity — 1) on the 
string for —1 < x < 1 and watching the resulting wave motion (as in the piano 
string). To find the displacement, we compute the D'Alembert solution 


1 x+ct 
u(x,t) = > | _, &(&) 4 


1 x+ct 


se 0 dé (x,t)e Region 1 
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x -trct 


d£ (x,t)e Region 2 


S pH! os pe Pile Pile Pl- 


(18.5) | dg | (x, t)e Region 3 


1 
| d& | (x, He Region 4 


| 0 dé (x,t)e Region 5 


d£ (x,t)e Region 6 


This solution is graphed at various values of time in Figure 18.5. 


FIGURE 18.5 Solution of problem (18.4) for various values of time. 


This completes our interpretation of the D’Alembert solution in the xt-plane. 
In the remainder of the lesson, we will solve the initial-boundary-value problem 
for the semi-infinite string 


PDE Un = cu, O<xrx< D<t<ow 
(18.6) BC u(0,) 0 O<t<.o 
u(x,0) = f(x) 
- a =g) 0573 


by modifying the D’ Alembert formula. 


Solution of the Semi-infinite String via the D'Alembert 
Formula 


The object now is to find the wave motion of the vibrating string whose left end 
is fixed at zero and has given initial conditions. To find the solution of (18.6), 
we proceed in a manner similar to that used with the infinite string, which is to 
find the general solution to the PDE 
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u(x,t) = ó(x — ct) + p(x + ct) 


If we now substitute this general solution into the initial conditions as we did 
in Lesson 17, we arrive at (same equations) 


ba- = if- ch- | O d 
(18.7) 


x+ct 


ve + e= fetei E| ad 


Xo 


We now have a problem we didn't encounter when dealing with the infinite 
string. Since we are looking for the solution u(x,t) everywhere in the first quad- 
rant (x 0, t > 0) of the xt-plane, it is obvious that we must find 


d(x — ct) for all -œ < x — ct < œ 
W(x + c)  forallO <x + ct< œ 


Unfortunately, the first equation of (18.7) only gives us d(x — ct) for x — ct 
= 0, since our initial data f(x) and g(x) are only known for positive arguments. 

As long as x — ct = 0, we have no problem, since we can substitute (18.7) 
into the general solution u(x,t) = o(x — ct) + w(x + ct) to get 


u(x,t)= d(x — ct) + b(x + ct) = 
=Sife- t+ fer ote] oat 


x~ Cf 
The question is, what to do when x < ct? This is where the BC u(0,t) = 0 comes 
into use. When x < ct, we use the BC of the problem to find (x — ct). 
Substituting the general solution u(x,t) = d(x — ct) + b(x + ct) into the BC 
u(0,t) = 0 gives 


b(—et) = — (ct) 
and, hence, by functional substitution 
bx - c= -tfa-xn-2] k+ K 
B 2 2c Jxo 5 


Substituting this value of $ into the general solution 


u(x,t) = d(x — ct) + W(x + ct) 


gives 
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X+ct 


u(x,t) = = lf + ct) — f(ct — x)| + aa as gt)di& O<x<ct 


and, hence, combining the solutions for x < ct and x > ct, we have our desired 
result 


x+ct 


1 1 
se = ct) + fle t cl t+ 5} sdb x ee 
(18.8) u(x,t) = 


x+ctl 


= [fl + ct) — f(ct — x)| + 1| g(&) dé x<ct 


See Figure 18.6. 
x «ct / 


l (Use modified D'Alembert / 
formula) / 


u (Xo, tg) /x*7« 
/ x> ct 
(Use D’Alembert’s formula) 


x + ct = xg * ctg 


n 
YS Disturbance 
reflected at 
/ the boundary 


/ Disturbance starting at (xo + cto, 0) 


traveling along this characteristic 


x + ct = cto - xg 


(cto - x9, 0) (xo + cto, 0) 


FIGURE 18.6 Interpretation of the semi-infinite string in the xf-plane. 


This completes our lesson; we will examine the interpretation of equation (18.8) 
in the notes. 


NOTES 


1. Equation (18.8) is what we would expect from the semi-infinite string with 
BC u(0,t) = 0. For x = ct, the solution is the same as the D’Alembert 
solution for the infinite wave, while for x « ct, the solution u(x,t) is modified 
as a result of the wave reflecting from the boundary. (The sign of the wave 
is changed when it's reflected.) 
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2. Solution (18.8) would not be the same if the BC u(0,t) = 0 were changed. 
Solutions can also be found with other BCs, such as 


Or 


u(0,t) — f(t) 
u,(0,t) = 0 


The reader can consult the reference in the reading list for additional in- 


formation. 
3. The straight lines 


x + ct 
x -— cl 


constant 
constant 


are known as characteristics, and it is along these lines that disturbances 
are propagated. Characteristics are generally associated with hyperbolic 


equations. 


PROBLEMS 


1. Solve the semi-infinite string problem 


PDE Un = U,, 0cx«o 0<t<o 
BC u(0,) =0 OK<t<m 
ICs Ee 0cx«o 


u,(x,0) = 0 


Draw the solution for various values of time. 
2. The solution of the semi-infinite string problem in problem 1 can also be 


found by 


(a) extending the IC to the whole real axis -œ < x < © via 


u(x,0) = — xe 


u(x,0) = 0 


— x2 


-o <x <0 
—o-«cx«0 


(b) averaging the two left- and right-moving waves as we did in the 


previous lesson 


(c) 


looking at the solution for x = 0 


Use this idea to graph the solution (for various values of t) for the IC shown 


in the following diagram. 


u 


u(x, 0) = fix) 


1 2 
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3. Solve the semi-infinite string problem 


PDE u, = Cu, 0c€x«o 0<t<o 
BC u(07)=0 O<t<o 


(x,0) = f(x) <x< o 
ICs o 0<x< 


in a manner analogous to the way the semi-infinite string problem was solved 
in the lesson; what is the interpretation of this problem? 

4. Suppose the vibration of a string is described by u, = u,, and has an initial 
displacement as given by the following diagram. 


u 


-4 -3 -2 -1 O 1 2 3 4 5 


Assuming the initial velocity u,(x,0) = 0, describe the solution of this prob- 
lem in the xt-plane. Note that in this problem, the IC u(x,0) is discontinuous. 


OTHER READING 


Techniques in Partial Differential Equations by C. Chester. McGraw-Hill, 1971. Chapter 
2 discusses many variations of D' Alembert's equation, including the semi-infinite problem 
discussed in this lesson. 
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Lesson 49 


Boundary Conditions Associated 
with the Wave Equation 


PURPOSE OF LESSON: To illustrate how the wave equation (with 


a bounded space variable) 
uU, = CU, O<x<L 0crt«o 


is generally associated with one of three general kinds of BCs 
1. Controlled end points (first kind) 


u(0,t) = git) 
u(L,t) = g(t) 


2. Force specified on the boundaries (second kind) 


u,(0,t) = g(t) 
u,(L,t) = g(t) 


3. Elastic attachment (third kind) 


u,(O,t) — y,u(0,t) = g(t) 
u,(L,t) — yju(L,t) = g(t) 


(or a mixture of these) and to illustrate the nature of solutions associated 
with these problems. 


So far, the only kind of wave motion we have discussed is the one-dimensional 
transverse vibrations of a string. The reader should realize that this is only the 
tip of the iceberg as far as wave motion is concerned. A few other types of 
important vibrations are: 

1. Sound waves (longitudinal waves) 

2. Electromagnetic waves of light and electricity 

3. Vibrations in solids (longitudinal, transverse, and torsional) 

4. Probability waves in quantum mechanics 

5. Water waves (transverse waves) 
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6. Vibrating string (transverse waves) 
The purpose of this lesson is to discuss some of the various types of BCs that 
are associated with physical problems of this kind. Here, we will stick to one- 
dimensional problems where the BCs (linear ones) are generally grouped into 
one of three kinds: 

1. Controlled end points (first kind) 


u(0,t) = g(t) 
u(L,t) = 82(t) 


2. Force given on the boundaries (second kind) 


u,(0,t) = gi() 
u,(L,t) = g2(t) 


3. Elastic attachment on the boundaries (third kind) 


u,(0,t) — y,u(0,t) = g(t) 
u,(L,t) = y2U(L,t) E g(t) 


We start by discussing BCs of the first kind. 


1. Controlled End Points 


We are now involved with problems like 


PDE Un = Cu, 0cx«1 0<t< x 
0,0) = g(t) 
19.1 BC ul 0<t<x 
on i wy = gj) 


0) - f) gera 
2d por li da EE 


where we control the end points so that they move in a given manner (Figure 
19.1). 


u (0, t) =g,(t) 


u (1, t) = g(t) 


FIGURE 19.41 Controlling the ends of a vibrating string. 
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A typical problem of this kind would involve suddenly twisting (at t = 1) the 
right end of a fastened rod so many degrees and observing the resulting torsional 
vibration (Figure 19.2). 


7 
IMEREEEX 


FIGURE 19.2 Torsional vibrations of a rod. 


In the area of mathematical control theory, an important problem involves 
determining the boundary function g;(t), so that a vibrating string can be shaken 
to zero in minimum time. 


u(O, t)=0 


2. Force Given on the Boundaries 


Inasmuch as the vertical forces on the string at the left and right ends are given 
by Tu,(0,t) and Tu,(L,t), respectively, by allowing the ends of the string to slide 
vertically on frictionless sleeves, the boundary conditions become 


u,(0,t) = 0 
u,(L,t) = 0 


See Figure 19.3. 


Frictionless sleeve 


FIGURE 19.3 Free BC on the string. 

Boundary conditions similar to these are presented in the following two ex- 
amples: 

(a) Free end of a longitudinally vibrating spring 

Consider a vibrating spring with the bottom end unfastened (Figure 19.4). 


u(0,t) » 0 
(Fastened end) 


ux(1,t) - 0 
(Free end) 


FIGURE 19.4 Free end of a vibrating spring 
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(b) Forced end of a vibrating spring 
If a force of v(t) dynes is applied at the end x = 1 (a positive force is measured 
downward), then the BC would be 


u,(1,t) = EO (k is Young's modulus) 


In the case of a forced BC, the ends of the string (or spring) are not required 
to maintain a given position, but the force that's applied tends to move the 
boundaries in the given direction. Physical problems like these come about in 
physics when an electric field (a force) is applied to vibrating electrons. 


3. Elastic Attachment on the Boundaries 


Consider finally a violin string whose ends are attached to an elastic arrangement 
like the one shown in Figure 19.5. 


u 


x 


h= spring constant 
(Stretched spring) 


FIGURE 19.5 Diagram illustrating elastic attachment. 


Here, the spring attachments at each end give rise to vertical forces proportional 
to the displacements 


Displacement at the left end = u(0,t) 
Displacement at the right end = u(L,t) 


Setting the vertical tensions of the spring at the two ends 


Upward tension at the left end = Tu,(0,1) 


Upward tension at the right end = — Tu,(L,t) (T = string tension) 


equal to these displacements (multiplied by the spring constant A) gives us our 
desired BCs 


(19.2) u,(0,t) = = u(0,) 


u,(L,t) = -7 (Lt) 
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Note that u(0,¢) positive means that u,(0,t) is positive, while if u(L,t) is positive, 
then u,(L,t) is negative. We can rewrite these two homogeneous BCs as 


h 
un 40.) — Z u(0,) = 0 


u,(L,t) + = u(L,t) = 0 


If the two spring attachments are displaced according to the functions 0,(t) and 
8,(t), we would have the nonhomogeneous BCs 


(19.4) u,(0,t) = = [u(0,) - €,(t)] 


u(Lt) = = È [uL - 40) 


See Figure 19.6. 


Vibrating String Moving end point 


u(L, t) - 65 (t) J^ 


h= spring constant 


FIGURE 19.6 Diagram illustrating nonhomogeneous elastic BCs. 


This completes our discussion of the most common types of BCs associated 
with hyperbolic problems. In the next few lessons, we will solve problems having 
BCs similar to these. 


NOTES 
1. Another BC not discussed in this lesson occurs when the vibrating string 
experiences a force at the ends proportional to the string velocity (and in 
the opposite direction). Here, we have the BC (at the left end) 
Tu,(0,t) = — Bu,(0,t) 
2. A nonlinear elastic attachment at the left end of the string would be 


Tu,(0,) = e[u(0,r)] 


150  Hyperbolic-Type Problems 


where ó(u) is an arbitrary function of u; for example, 


Tu,(0,t) = —hu3(0,t) 
says that the restoring force at the left end of the string is proportional to 


the cube of the displacement and not to u (as it was in the linear case with 
Hooke’s law). 


If a mass m is attached to the lower end of a longitudinally vibrating string, 
the BC would be 


mu,(L,t) = — ku,(L,t) + mg 


PROBLEMS 


1. From your intuition of the various kinds of BCs, draw a rough sketch of the 
solution to 


n= Cu, O<x<l 0ct«o 


u(1,t) = sint DSSS 
u(x,0) = 
ICs = -0 0zxxx1 


for various values of time. 
2. Draw a rough sketch of the solution to 


m 0cx«i 0ct«o 
= 0 
up ao OSES 


u(x,0) = sin (mx/2) 
ICs bee -0 0zxx1 


for various values of time. Can you guess the solution to this problem? 
3. What is the general nature of the BC 


4(0,) = z.[u0,) — 6,0) 
when 


(a) he 
(b A0 
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Does this agree with your intuition? 
4. Draw a rough sketch of the solution to 


PDE Hu, = U, 0cx«1 0<t<o 


x 


u(0,t) = 0 
Be bee = -a VSS 


u(x,0) = x 
ICs pur - 0 0xxx1 


OTHER READING 


Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks/Cole, 
1973. An excellent text with an extensive chapter (Chapter 2) on initial and boundary 
conditions. 
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LESSON 20 


[he Finite Vibrating String 
(Standing Waves) 


PURPOSE OF LESSON: To show how transverse vibrations of a finite 
string described by the IBVP 


uU, = QU, 0<x<L 0«t«o 


u(0,t) = 0 
BCs pee -0 0<t<o 


TS m = f(x) 


u(x,0) = g(x) 


can be found by the standard technique of separation of variables and to 
show how the solution u(x,t) can be interpreted as the infinite sum 


u(x,t) = X XT) 


of simple vibrations where the shape X,(x) of these fundamental vibrations 
are solutions (eigenfunctions) of a certain Sturm-Liouville boundary-value 
problem. 


So far, we have studied the wave equation u,, = c?u,, for the unbounded domain 
—9o < x < o and have found (D'Alembert's solution) solutions to be certain 
traveling waves (moving in opposite directions). When we study the same wave 
equation in a bounded region of space 0 « x « L, we find that the waves no 
longer appear to be moving due to their repeated interaction with the boundaries 
and, in fact, often appear to be what are known as standing waves. For instance, 
consider what happens when a guitar string (fixed at both ends x = 0,L) de- 
scribed by the simple hyperbolic IBVP 

PDE uU, = ou 0<x<L 0ct«o 


xx 


u(0,t) = 0 
BCs nee 0crt«o 
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0) = f(x) 
Ics — j^ 0<x<L 
i = g(x) 

is set in motion. What happens is that the traveling-wave solution to the PDE 
and IC keeps reflecting from the boundaries in such a way that the wave motion 
does not appear to be moving, but, in fact, appears to be vibrating in one 
position; for example, a few typical standing waves are shown in Figure 20.1. 


as e om an aw 


- 
~a — 


"— anes auem Uo 


X^x) T(t) = secondary standing wave 


com 


X3(x) T4(t) = third standing wave 


FIGURE 20.1 Three typical standing waves X(x) TĦ. 


If we knew the shapes X,(x) of these standing waves and how each one of them 
vibrated T, (t), then all we would have to do to find the solution of the vibrating 
guitar string is sum the simple vibrations X,(x)T7,,(t) 


oc 


u(x,t) = 2, ¢,X,(x)T,(t) 


n-i 


in such a way (find the coefficients c,) that the sum agrees with the ICs u(x,0) 
= f(x), u(x,0) = g(x) when t = 0. 

We will now solve the guitar-string problem by the method of separation of 
variables. 


Ms aration-of-Variabies Solution to the Finite Vibrating 
ring 


To solve the IBVP 
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PDE U, = QU, 0<x<L 0ct«o 


0,) 20 
(20.1) BCs n 0  Q«rco 
(x,0) = f(x) eae 
NS s =g) Wwe 


we start by seeking standing-wave solutions to the PDE; that is, solutions of the 
form 


u(x,t) = X(x)T(t) 


Substituting this expression into the wave equation and separating variables gives 
us the two ODEs 


T’ — a&dAT = 0 
X'—AX-0 


where the constant à can now be any number ~œ < \ < œ, 
Investigating the solutions of these two ODEs for all different values of À 
yields the diagram in Figure 20.2. 


Possible values of A 


T (t) = Ae/a8)t + ge -(a8) : 
X (x) = CeP* + De~b* 


T(t  At* B 
X (x) = Cx * D 


T (t) =A sin (aft) + B cos loft) 
X (x) = C sin (fx) + D cos (Bx) 


u(x, t) = X (x) T(e) 


FIGURE 20.2 Standing-wave solutions for different values of A. 


The idea now is to prune away all those standing waves that either are unbounded 
as f —> œ or else yield only the zero solution when substituted into the BCs u(0,t) 
= u(L,t) = 0. It will be left as an exercise for the reader to verify that only 
negative values of à give feasible (nonzero and bounded) solutions. Hence, our 
goal is to find the constants A, B, C, and D and the negative separation constant 
à so that the expression 


(20.2) u(x,t) = [C sin (Bx) + D cos (8x)][A sin (ofi) + B cos (aßt)] 
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satisfies the BCs. This will give us the collection of fundamental vibrations of 

the string, and the final goal will then be to sum them (the sum will still satisfy 

the PDE and the BC), so that the sum agrees with the IC when ż = 0. 
Plugging (20.2) into u(0,t) = u(L,t) = 0 gives 


u(0,t) = X(0)T(t) = DIA sin (aBt) + B cos (aBs)] = ODS D = 0 
(20.3) wu(L,t) = X(L)T(t) 
= C sin (8L)[A sin (af) 
+ B cos (aßt)] = 0 > sin (BL) = 0 


In other words, the separation constant 8 (we can forget about à and find 8) 
must satisfy sin (BL) = 0 or 
nm 


B. = T n=0,1,2,... 


Note that if we choose C = 0 in the second equation of (20.3), we would get 
X(x)T(t) = 0. Hence, we have now found a sequence of simple vibrations (which 
we subscript with 7) 


(20.4) 4, (x,t) = X, (x)T,(f) = sin (nmx/L)[a, sin (nmat/L) + b, cos (ntrat/L)| 
n = 1,2,3,... 


Or 
u,(x,t) = R, sin (nmx/L) cos [nta(t — 8,)/L] 


(where the constants a,, b,, R,, and 8, are arbitrary) all of which satisfy the 
wave equation and the BCs. The reader should be able to see that this sequence 
of functions constitutes a family of standing waves (which have the property that 
, each point on the wave vibrates with the same frequency) whose shapes look 
like Figure 20.3. 


— psi 


To v— aus ow 


uy (x, t) 


U3 (x, t) 


FIGURE 20.3 Standing waves uxt = XOT AP. 
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Since any sum of these vibrations is also a solution to the PDE and BCs (since 
the PDE and BCs are linear and homogeneous), we add them together in such 
a way that the resulting sum also agrees with the ICs. This will then be the 
solution to our problem. Substituting the sum 


oc 


u(x,t) = >) sin (nnx/L){a, sin (nmat/ L) + b, cos (ntat/L)] 


n=1 
into the ICs 


u(x,0) — f(x) 
u(x,0) — g(x) 


gives the two equations 
> b, sin (nmx/L) = f(x) 
>» a,(nta/L) sin (ntx/L) = g(x) 
and using the orthogonality condition 


L 
. ; _ J 0 
[ sin (mmx/L) sin (nux/L) dx = 2 PESA 


we can find the coefficients a, and b, 


2 
NTA 


ll g(x) sin (nax/L) dx 


= = { f f(x) sin (nmx/L) dx 


where the coefficients a, and b, are given by (20.5). This completes the problem, 
but before we close, we will make a few useful observations. 
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NOTES 


1. 


If the initial velocity of the string is zero, then the solution (20.6) takes the 
form 


u(x,t) = 2, b, sin (nmx/L) cos (ntrat/L) 


and has the following interpretation. Suppose we break the initial string 
position 


u(x,0) = f(x) 


into simple sine components 


f(x) = Y b, sin (nmx/L) 


and let each sine term vibrate on its own according to 

u,(x,t) = b,sin (nmx/L) cos (nvat/L) 
(this is a fundamental vibration). If we now add each individual vibration 
of this type, we will get the solution to our problem. For example, suppose 
our initial string position f(x) is 


f(x) = sin (nx/L) + 0.5 sin (3nx/L) + 0.25 sin (5mx/L) 


The overall response to this IC would then be the sum of the responses to 
each term; that is, 


u(x,t) = sin (nx/L) cos (mat/L) + 0.5 sin (3mx/L) cos (3mat/L) 
+ 0.25 sin (Sax/L) cos (Strat/L) 


The n-th term in the solution (20.6) 
sin (nmx/L) [a, sin (nmat/L) + b, cos (nmat/L)] 


is called the n-th mode of vibration or the n-th harmonic. By using a trigono- 
metric identity, we can write this harmonic as 


R, sin (nax/L) cos [ntra(t — 8,)/L] 
where R, and ò, are the new arbitrary constants (amplitude and phase angle). 


This new form of the n-th mode is more useful for analyzing the vibrations. 
Note that the frequency w, (rad/sec) of the n-th mode is 
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NTA nm IT 


QO. = ———— = — — 


7 L L Vp 


(T,p are tension and density of the string, respectively) 


Note, too, that this frequency is n times the fundamental frequency (n = 1). 
The property that all sound frequencies are multiples of a basic one is not 
shared by all types of vibrations. This has something to do with the pleasing 
sound of a violin or guitar string in contrast to a drumhead, where the 
higher-order frequencies are not multiple frequencies of the fundamental 
one. 


PROBLEMS 


1. Find the solution to the vibrating-string problem (20.1) if the ICs are given 
by 


u(x,0) = sin (mx/L) + 0.5 sin (3nx/L) 
u(x,0) = 0 


Graph this solution for various values of time. Is the solution periodic in 
time? What is the period? 
2. What is the solution of the vibrating-string problem (20.1) if the ICs are 


u(x,0) = 0 
u,(x,0) = sin (3mx/L) 


What does the graph of the solution look like for various values of time? 
3. Show that for à = 0 in Figure 20.2, the solutions X(x)T(t) are either un- 
bounded or zero. 
4. What is the solution of the vibrating-string problem if the ICs are 


u(x,0) 
u,(x,0) 


sin (3mx/L) 
3vra/L) sin (3mx/L) 


5. A guitar string of length L = 1 is pulled upward at the middle so that it 
reaches height h. Assuming the position of the string is initially 


u(x,0) = 2hx 0zxx0.5 
i 2h(1 — x) 0.5 xxl 


| 
n 


0 1 
Initial position of the string 
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what is the subsequent motion of the string if it is suddenly released? 
6. Solve the damped vibrating-string problem 


PDE u, = o?u,, — Qu, 0<x<1 0<t<% 
u(0,t) = 0 
BCs me 0ct«o 
u(x,0) — f(x) 
ICs por -0 0zxx1 


Does the solution seem reasonable? Does it satisfy the above PDE, BCs, 
and ICs? 

7. How would you solve the nonhomogeneous PDE with given boundary and 
initial conditions 


PDE Hu, = QU, + Kx 0cx«1 0<t<a 
u(0,t) = 0 
BCs EM -0 0ct«o 
u(x,0) — f(x) 
ICs ard 20 0<x<1 


OTHER READING 


Advanced Engineering Mathematics by C. Wylie. McGraw-Hill, 1970. A very readable 
text that contains many interesting examples; see in particular Chapter 7. 
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LESSON 21 


The Vibrating Beam (Fourth-Order 
PDE) 


PURPOSE OF LESSON: To illustrate how higher-order PDEs come 


about in the study of vibrating-beam problems and to solve the problem 
of a vibrating beam with simply supported ends by separation of variables. 
It is also pointed out how the vibrations of the beam compare with the 
vibrations of the violin string. 


ug + OU xxx = 0 (Beam equation) 


u(0O, t)=0 
uy, (0, t) = 0 


Simply supported beam 


The major difference between the transverse vibrations of a violin string and 
the transverse vibrations of a thin beam is that the beam offers resistance to 
bending. Without going into the mechanics of thin beams, we can show that this 
resistance is responsible for changing the wave equation to the fourth-order 
beam equation 


(21.1) Uy, = i= OU NN 

where 

a? = Kip 

K = rigidity constant (the larger K, the more rigid the beam and the faster 


the vibrations) 
linear density of the beam (mass/unit length). 


p 


The derivation of this equation can be found in reference 1 of Other Reading. 
Since this is the first time the reader has seen an application of PDEs higher 
than second order in this text, it will be useful to solve a typical vibrating-beam 
problem. Later, we will talk about other types of beam problems. 
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The Simply Supported Beam 


Consider the small vibrations of a thin beam whose ends are simply fastened to 
two foundations. By “simply fastened,” we mean that the ends of the beam are 
held stationary, but the slopes at the end points can move (the beam is held by 
a pin-type arrangement, Figure 21.1). 


u(1,t) » 0 
uxx (1, tl =0 


u(0,t) - O 
uxx (0, t) = 0 


FIGURE 21.4 A simply supported beam. 


It seems clear that the BCs at the ends of the beam should be 


but what isn’t so obvious is that the two BCs 


u,.(0,t) = 0 
u,,(1,t) = 0 


also hold at the two ends. Using the theory of thin beams (see reference 1 of 
Other Reading), we can show that the bending moment of the beam is repre- 
sented by u,, and a simply fastened beam should have zero moments at the end 
points. Hence, the vibrating beam in Figure 21.1 can be described by the IBVP 
(a is set equal to one for simplicity) 


PDE Un = — Urey 0<x<1 0ct«o 
u(0,t) = 0 
u,,(0,t) = 0 
(21.2) BCs u(1,t) = 0 0ct«o 
u,, (1,t) = 0 


(x,0) = f(x) STe 
e erg) 05s] 


To solve this problem, we use the separation of variables method and look for 
arbitrary periodic solutions; that is, vibrations of the form 
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(21.3) u(x,t) = X(x)[A sin (wt) + B cos (ot)] 
Note that by choosing the solution in the form (21.3), we are essentially saying 
that the separation constant in the separation-of-variables method has been 
chosen to be negative. 

We now substitute equation (21.3) into the beam equation to get the ODE 
in X(x). 

X" — w*X = 0 
which has the general solution 
X(x) = C cos Vwx + D sin Vox + E cosh Vox + F sinh Vax 

To find the constants C, D, E, and F, we substitute this expression into the BCs, 


giving 


u(0,) 202» X(0)T(t) 202 X(0)=0 2C E-0 


u,.(0,t)=0 > X"(0)T(t)=0 > Y'(0-0 2-C«E-o[7€-P* 


u(1,) = 02» D sin Vo + Fsinh Vo = 0 
u,(1,t) =0> -D sin Vw + Fsinh Vo = 0 
From these last two equations, we arrive at the expressions 


F sinh Vw = 0 
D sin Vo = 0 


from which we can conclude 


F=0 
sin Vw = 0> = (nn? n=1,2,... 


In other words, the natural frequencies of the simply supported beam are 
w, = (nt)? 
and the fundamental solutions u,, (solutions of the PDE and BCs) are 


u, (x,t) = X,(x)T,(t) = [a, sin (nm)?t + b, cos (nt)?t] sin (nux) 


Now, since the PDE and BCs are linear and homogeneous, we can conclude 
that the sum 
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(21.4) | u(x,t) = y [a, sin (nm)?t + b, cos (nm)'t] sin (nx) 


also satisfies the PDE and BCs. Hence, all that remains to do is choose the 
constants a, and b, in such a way that the ICs are satisfied. Substituting equation 
(21.4) into the ICs gives us 


u(x,0) = f(x) = Y b, sin (nmx) 
(21.5) n=l 


u(x,0) = g(x) = 5 (naya, sin (nux) 


and using the fact that the family (sin (x)) is orthogonal on the interval [0,1] 
gives us 


a, = X f g(x) sin (nmx) dx 


(21.6) 
b, = 2 l f(x) sin (nmx) dx 


Hence, the solution is given by (21.4), and a, and b, are given by (21.6). 
In order for the reader to understand this problem, we present a simple 
example. 


sample Vibrating Beam 
Consider the simply supported beam shown in Figure 21.2 with ICs 


sin (wx) + 0.5 sin (37x) 


FIGURE 21.2 Simple vibrations of a simply supported beam. 
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We could find the solution by substituting the values of f(x) and g(x) into equation 
(21.6), but it seems easier to look at equations (21.5) and simply make the 
observation that 


for alln = 1,2,... 


3 


— 


5 


Ww 


SSO SS Sf 


3 


0 
= 1 
= 0 
0. 
0 


Hence, the solution is 
u(x,t) = cos (mt) sin (mx) + 0.5 cos (9n7t) sin (37x) 


It is interesting to see how this solution compares with the vibrating string with 
the same ICs. If we look back to Lesson 20, we find that the solution to the 
vibrating-string problem is given by 


u(x,t) = cos (mt) sin (mx) + 0.5 cos (3mt) sin (37x) 


In other words, the vibrating beam vibrates at higher frequencies than does the 
vibrating string. It would be interesting forthe reader to imagine just how each 
of these vibrations looks. Note, however, that both higher frequencies are integer 
multiples of the fundamental frequencies. 


NOTES 


1. Beams are generally fastened in one of three ways 
(a) Free (unfastened) 
(b) Simply fastened 
(c) Rigidly fastened 
Some sketches are given in Figure 21.3 along with their BCs. 
2. Another important vibrating-beam problem is the cantilever-beam problem 
shown in Figure 21.3. The solution to this vibrating beam is not the usual 
sum of products of sines and cosines, but due to the nonstandard BCs, 


u(0,t) = 0 
u,(0,t) = 0 
u,,(1,t) = 0 
U,.(1,t) = 0 


we arrive at the more complicated solution 
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uxx (1, t) - O 
Uyyy (1, t) = O 


M 
x — (Free end) 
M 


u(0,t) 0 — 
u,(0,t)=0 =z 


(Rigidly fastened) 


(a) Cantilever beam. 


Zo u(i,t)=0 


u (0,1) 20 
- wu. (1,020 


ux (0, t) - 0 — 7z 


(b) Beam rigidly fixed at each end. 


u (0, t) - O u(1,t) 30 
ux (0, t) - O uy, (1, t) =0 


a 
(c) Beam rigidly fastened at left; simply fastened at right. 


FIGURE 21.3a-21.3c Typical beam problems. 


u(x,t) = Y X, (x) [a, sin (w,t) + b, cos (o,1)] 


where the eigenfunctions (basic shapes of vibrations) are given by linear 
combinations of sines, cosines, hyperbolic sines, and hyperbolic cosines. 
The solution to this problem can be found in reference 3 of Other Reading. 


PROBLEMS 


1. Solve the cantilever-beam problem 


PDE Un + uuu, = 0 0cx«1 0O<t<e« 
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u(0,t) = 0 


u,(0,¢) = 0 

we eg, vmews 
U,,,(1,t) ES 0 
u(x,0) = f(x) 

ICs | u(x,0) = g(x) 0xxxl1 


HINT Although the eigenfunctions X,(x) in this problem are not the usual 
sine functions, we can still use the Sturm-Liouville theory to say that the 
eigenfunctions are orthogonal on [0,1]. 


2. What is the solution to the simply supported beam (at both ends) with ICs 


u(x,0) = sin (qx) 
u,(x,0) = sin (nx) supe 


3. What is the solution to the simply supported beam problem with ICs 


u(x,0) = 1 — x? 
u,(x,0) = 0 


4. Let the left end (x = 0) of a beam be rigidly fastened to a wall and let the 
right end (x = 1) be simply fastened according to the BCs shown in Figure 
21.3. Solve the beam problem with these BCs and tell how to find the natural 
frequencies of vibration of this beam. Knowing the natural frequencies of 
the beam is important, since various kinds of inputs of the same frequency 
can give rise to resonance. 


OTHER READING 


1. Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks-Cole, 1973. 
Chapter 5 contains a derivation of the vibrating-beam problem. 


2. Mathematical Methods in Physics and Engineering by J. W. Dettman. McGraw-Hill, 1962; 
Dover, 1988. This text contains a large section on the Sturm-Liouville problem. 


3. Advanced Mathematics for Engineers by C. R. Wylie. McGraw-Hill, 1961. This book 
contains the solution of the cantilever-beam problem. 
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LESSON 22 


Dimensionless Problems 


PURPOSE OF LESSON: To show how boundary-value problems, 
initial-value problems, and other types of physical models can be written 
in dimensionless form. In this form, we replace the original variables of 
the problem by new dimensionless ones (they have no units). 

By writing a problem in dimensionless form, specific equations from 


physical, chemistry, biology, and economics that originally look different 
become one and the same. For this reason, the mathematical study of 
PDEs generally doesn't concern itself with the physical parameters in the 
equations. It is up to the chemist, physicist, or biologist to transform his 
or her equation into those in the textbook. 


The basic idea behind dimensional analysis is that by introducing new (dimen- 
sionless) variables in a problem, the problem becomes purely mathematical and 
contains none of the physical constants that originally characterized it. In this 
way, many different equations in physics, biology, engineering, and chemistry 
that contain special nuances via physical parameters are all transformed into the 
same simple form (Figure 22.1). | 


Problems in engineering 


Problems 


Problems 


Basic mathematical problem 


in in 
physics biology 


Problems in chemistry 


FIGURE 22.4 Several problems converted to one basic nondimensional form. 


To see how this process works, let's consider a simple example. 


Converting a Diffusion Problem to Dimensionless Form 


Suppose we start with the initial-boundary-value problem where the temperature 
is initially u(x,0) = sin (mx/L), but the boundaries are then instantly raised to 
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T, and T;. In other words, we have 


PDE U, = o?u,, O<x<L 0<t<o 
u(0,t) = T, 
(22.1) BCs m - T, 0ct«o 


IC u(x,0) = sin (mx/L) O<x<L 


See Figure 22.2. 


= T; 


u (L, t) 


0 u(x, 0) = sin (1x/L) L 


FIGURE 22.2 Domain for the heat-flow problem. 


Our goal is to change problem (22.1) to a new equivalent formulation that has 
the properties 


1. No physical parameters (like a) in the new equation 

2. The initial and boundary conditions are simpler 
To do this, we will introduce three new dimensionless variables U, £, and + that 
take the place of u, x, and t, respectively 


u —— — —— —» U (dimensionless temperature) 
x — E (dimensionless length) 
t —————— r (dimensionless time) 


We carry out these three transformations one at a time for simplicity. 


Transforming the Dependent Variable u — U 
We define U(x,t) by 


u(x,t) — T, 


U(x,t) = T, - T, 


It's clear that this new temperature U(x,t) has no units, since we are dividing 
°C by °C. It's also clear why we chose U(x,t). You can see that the new BCs for 
U(x,t) at x = O and L will be U(0,t) = 0 and U(L,t) = 1. In fact, let's examine 
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the new transformed problem for U(x,t). With a little effort, we can see that the 
original problem (22.1) has now been transformed into 


PDE U = æU, O<x<L O0K<t<~ 


U(0,t) = 0 
(22.2) BCs Poe L 0<t<o 
IC U(x,0) = undi O<x<L 
T, 7 T, 


If we wished, we could stop here and solve for U(x,t) and then solve for u(x,t) 
from the formula 


u(x,t) = T, + (T, — T)U(x1) 


Let's continue, however, and transform the independent variables x and t. Next, 
we transform the space variable x. 


Transforming the Space Variable x — ë 


It seems obvious how we should pick the dimensionless-space variable &. Since 
0 s x < L, we pick 


= x/L 
By computing the derivatives 
U, = U&, = 7U, 
Un = Uy 


it is clear that the next problem (in U, £, and t) is 


PDE U, = (ALyYU, | 0«£«1 0<t<e« 


U(0,t) = 0 - 
(22.3) BCs Py 21 0<t< 
_ sin (m£) — T, | 
IC U(&0) =  L-T, — T, 0xé&x1 


We are now two-thirds of the way toward our goal. The final step is to introduce 
a dimensionless time 7, so that the constant [o/L |? disappears from the differential 
equation. 
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Transforming the Time Variable 7 — + 


How to introduce a new dimensionless time isn't quite so clear as choosing the 
first two variables. However, since our goal is to eliminate the constant [o/L P 
from the PDE, we proceed as follows: 

1. Trya transformation of the form 7 = ct, where c is an unknown constant 

2. Compute u, = u,T, = cu, 

3. Substitute this derivative into the PDE to obtain 


cu, = [o/L fug 
and, hence, pick c = [o/L]^. This gives us our new time 
t = [o/LPt 


Using this transformation on our previous problem (22.3), we have the com- 
pletely dimensionless problem (U, &, and 7) 


PDE U, = U, O<€<1 OK<tT<~ 


U(0,7) = 0 
(22.4) BCs | uay- 997** 


IC U(£0 = of) 1 0x&sx1 


sin (c£) — T, 
where (&) = T, — T, 

This new dimensionless problem has the following properties: 

1. No parameters in the PDE 

2. Simple BCs 

3. IC hasn't essentially been changed (still a known function) 

4. Problem is simpler and more compact than the original one 
The solution to this problem can be found once and for all, so if a scientist 
transformed his or her original problem (22.1) to this dimensionless one (22.4) 
and found the answer U(é,7) in a textbook or research journal, he or she could 
find the solution u(x,t) to the original problem (22.1) by merely computing 


u(x,t) = T, + (T, — T)U(IL, tiL?) 


This completes our discussion of transforming problems into dimensionless form. 
There aren't any set rules on how the new variables are defined; we more or 
less have to use physical intuition and try various possibilities. 

We finish this lesson with a simple example of how to transform into dimen- 
sionless form, solve the new problem, and transform back to the original lab- 
oratory coordinates. 


Dimensionless Problems . 171 


Example of Transforming a Hyperbolic Problem to 
Dimensionless Form 


Consider the vibrating string 


PDE u, = QU, 0<x<L 0ct«v 


(22.5 BCs | 0ct«o 


u(x,0) = sin (nx/L) + 0.5 sin (3nx/L) 
ICs I = 0 O<sx<L 


By transforming the independent variables (no need to transform u) into to new 
ones 


t - xL and 7 = [o/L]t 


we get the new problem 


PDE Un = Ug O<E<1 Occo 
u(0,7) = 0 
(22.6) BCs eae -0 0<tT< 0 
u(é,0) = sin (m) + 0.5 sin (377) 
ICs MM 2% 0x£x1 


which has the solution 
u(& T) = cos (mT) sin (më) + 0.5 cos (317) sin (3m£) 


If we now transform back to coordinates x and t, we have the solution to our 
original problem (22.5) 


u(x,t) = cos (mat/L) sin (mx/L) + 0.5 cos (3mat/L) sin (3mx/L) 


NOTES 


1. Dimensional analysis is especially important in numerical analysis, since 
most computer programs are written in a general form and don't solve 
problems with a great many physical parameters. Anyone using these pro- 
grams must transform the problem into the form accepted by the program, 
solve the transformed problem, and then transform the numerical results 
back to his or her own coordinates. 
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2. Dimensional analysis allows mathematicians to work with PDEs without 
bothering with a lot of parameters and constants that are not relevant to 
the mathematical analysis. 

3. It’s not always necessary to transform all the variables into dimensionless 
form; sometimes only one or two have to be transformed. 


PROBLEMS 


1. Transform the vibrating string problem (22.5) into dimensionless form (22.6) 
by means of the transformations 


E=xL += [o/L]t 
2. Find the dimensionless formulation for the problem 
PDE U, = au 0<x<L 


xx 


u(0,t) = T, 
BCs m 0O<t<o 


IC u(x0)-2 T, O<x<L 


3. Transform problem (22.1) into (22.2) by means of the change of variable 


u(x, t) a T, 


U(x,t) — T, — T, 


4. Can you think of a physical reason why the new time variable 7 = at would 
eliminate the parameter a’ in the wave equation 


Uu, = o?u 


Remember what a means in terms of the velocity of the wave; intuition 
plays a major role in finding the most desirable new coordinates. 

5. How could you pick a new space variable & so that v is eliminated in the 
equation 


u, + vu, = 0 


OTHER READING 


Dimensional Analysis and Theory of Models by H. L. Langhaar. John Wiley & Sons, 
1951. A well-written book that contains many more aspects of dimensional analysis than 
does this lesson. 
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LESSON 23 


Classification of PDEs (Canonical 
Form of the Hyperbolic Equation) 


PURPOSE OF LESSON: To show how the second-order linear PDE 


in two independent variables 
Au,, + Bu, + Cu,, + Du, + Eu, + Fu = 


(A, B, C, D, E, F, and G are functions of x and y and could be constants) 
can be categorized as either 


1. Hyperbolic (if B? — 4AC > 0) 
2. Parabolic (if B? — 4AC = 0) 
3. Elliptic Gf B? — 4AC < 0) 


and to show how new coordinates € = &(x,y) and yn = (x,y) are introduced 
(in place of x and y) that simplify the equation. When this PDE is written 
in terms of the new coordinates & and n, it takes on one of three canonical 
forms (depending on whether B? — 4AC is positive, zero, or negative, 
respectively) 


i |: -Unm = VCE, m U, ug u,) ba canonical forms A 


Uz, = P(E, N, U, Uy Un) the hyperbolic equation 


the canonical form for 
the parabolic equation 


2. Um = P(E m U, u, u,) ( 


the canonical form for 
the elliptic equation 


3. ug + Um = P(E, n U, Ug U,) ( 


where ® is and Y are functions of the first derivatives u; and u,, the 
dependent variable u, and the new independent variables £ and n. The 
exact functions and V depend, of course, on the original equation. 
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The reader may think offhand that a chapter dealing with the classification of 
PDEs should occur at the beginning of the book; this is probably true, and many 
books do begin by discussing this subject. However, it is true, too, that most 
students do not get very excited about studying something they know nothing 
about, and for that reason, we have waited until now to introduce the topic of 
classifying PDEs. 

The purpose here is to classify the PDE 


(23.1) Au,, + Bu,, + Cu, + Du, + Eu, + Fu = G 


(where A, B, C, D, E, F, and G are, in general, functions of x and y) as 

1. Hyperbolic at a point (xy y,) if B^(xy,y,) — AA(xoyo)C(xo yo) > 0. 

2. Parabolic at a point (xy, Yo) if B(xo Yo) — 4A(xsyo)C(xo yo) = 0 

3. Elliptic at a point (xo, yo) if B?(xo Yo) — AA(xoyo)C(xo yo) < 0. 
and depending on which is true, to transform the equation into a corresponding 
canonical (simple) form. In order for the reader to understand the classification 
scheme, we first give four examples of hyperbolic, parabolic, and elliptic equa- 
tions. 


Examples of Hyperbolic, Parabolic, and Elliptic 
Equations* 


1. The heat equation u, = u,, is a second-order linear equation of the form 
(23.1) with coefficients 
A B=0 C#=0 
= 0 


= ] D=0 
| Se | F = 0 


G 


so B? — 4AC = 0 for all x and t; hence, the equation is parabolic for all 
x and t. Note that we have called the time variable y in the general 
equation. In fact, we would have gotten the same result if we called the 
x in the heat equation the y in the general equation and then called the 
time variable ¢ the x in the general equation. 

2. The wave equation u, = u,, is also of the form (23.1) with coefficients 


A-1 B=0 C =-1 D=E=F=G=0 


Hence, B? — 4AC = 4 for all x and t, and the equation is hyperbolic for 
all x and t. 


* It should be pointed out that the examples are prototypes of the more general parabolic, 


hyperbolic, and elliptic equations and that the behavior of these examples characterizes 
much of the general situation. 
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3. The Laplace’s equation u,, + u,, = 0 is elliptic for all x and y, since B? 
— 4AC = -4« Q0. 

4. The linear equation xu,, + u,, = sin x with variable coefficients is also 
of the form (23.1), but now B? — 4AC = —4x, and, hence, the equation 
is 

Elliptic for x ^ 0 

Parabolic for x = 0 

Hyperbolic for x < 0 
This example brings out the fact that equations with variable coefficients 
can change form in different regions of the domain. 

The reader should note, too, that whether equation (23.1) is hyperbolic, 
parabolic, or elliptic depends only on the coefficients of the second derivatives; 
it has nothing to do with the first-derivative terms, the term in u, or the non- 
homogeneous term. 

We now come to the major portion of this lesson: rewriting hyperbolic equa- 
tions in their canonical form. It turns out that if an equation is hyperbolic (in a 
given region of space), then it is possible to introduce new coordinates € and y 
(characteristic coordinates) in place of the original x and y, so that the equation 
takes on the simple form 


(23 .2) Uz, = P(E, N, u, Ut, n» 


This equation contains only one second derivative u,,, while the function ®(é, 
N, U, Ug, U„) is some function of the new independent variables € and n, the 
dependent variable u, and the first derivatives u,, u,. The exact form of the 
function ® depends, of course, on the original equations, and finding it, along 
with the new coordinates € and n, is the object of this lesson. 


The Canonical Form of the Hyperbolic Equation 
We start with the general PDE 
(23.3) Au, + Bu,, + Cu,, + Du, + Eu, + Fu = G 


where B? — 4AC > 0 in our domain of interest. The object here is to introduce 
new coordinates 


pu E(x,y) 
1 (x,y) 


so that the general PDE contains only one second derivative u,, (it turns out 
that if we tried to transform a hyperbolic equation into the elliptic or parabolic 
canonical forms, the technique wouldn’t work). 

First of all, we compute the partial derivatives 
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uy = ue, + UM 

U, = US, + UM, 

(23.4) uy, = uat, + Zu Em. t M I T u.t,, T una 
Ury = Ugy + us (En, + En) + umm, + wey + um, 
yy Ub; T: 2u, 5n, + UnnNy + uty, + Unyy 


& 
I 


Substituting these values into the original equation (23.3), we have 


(23.5) Aug + Bug, + Cu,, + Du, + Eu, + Fu = G 
where 
A = AE + B&£, + CE 
B = 2AE,n, + Blm, + Em.) + 2CEn, 
C= Ani + Bun, + CH 
(23.6) D = Aé,, + Biy + C&, + DE, + Ek, 
E = An, + Bn, + Cn, + Dn, + En, 
F-F 
G=G 


These calculations, although mathematically straightforward, are quite cumber- 
some. The reader will get a chance to carry them out in the problem set. 


The next step in our process is to set the coefficients A and C in equation 
(23.5) equal to zero and solve for the transformation & = (x,y), n = (x,y). 
This will give us the coordinates that reduce the original PDE to canonical form; 
SO, setting 


A = AE + BEE, + CE = 0 
C = An + Bun, + C; = 0 


we then rewrite these two equations in the form 


A[é/é,)? + B[£/£5] + C = 0 
A[n,/n,? + Bln/n,] + C = 0 


Solving these equations for [£,/£,] and [n,/n,], we find 


-B + VĒ: — 4AC 
[££] = —— a 
(23.7) (characteristic equations) 
-B —- VB? — 4AC 
[n/n,] T 12A 
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Note that [é,/&,] and [n,/n,] each have two solutions to their quadratic equations, 


but we only have to find one solution for each in order for A and C to be zero. 
The only restriction is that we don't pick the same roots, or else we will end up 
with the two coordinates the same. 

We have now reduced the problem to finding the two functions &(x,y) and 
n(x,y) so that their ratio [£,/£,] and [n,/n,] satisfy equation (23.7). Finding func- 
tions satisfying these conditions is really quite easy once we look for a few 
moments at Figure 23.1. 


y 


E(x, y) = constant 
di-t.dx*ttydy-0 
Hence, dy/dx = -[£, /£y] 
n (x, y) = constant 
dn 7 n,dx + ny dy =0 
dyldx = - [ny] 


FIGURE 23.4 Characteristic curves (x,y) = c and (xy) = c. 


To understand how we find & and m from this figure, consider the simple equation 


U — 4u,, + u, = 0 B? — 4AC = 16>0 


whose characteristic equations are 


B- VB-4ÀÀC — 
= - E] — 5 — - -2 


y B + VB? — 4AC 
2 = = [adn] = —— -2 


To find & and yn, we first solve for y (integrating), getting 


y -— Um 2x T Ci 

y-2x tc 
and, hence, to find & and n, we solve for the constants c, and c,, leaving them 
on the right-hand side of the equations while moving everything else to the left. 


The functions of x and y on the left are & and «; that is, 


E=yrt2x=c, 
-y-2x-c 
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It is clear that the functions € and y satisfy the above characteristic equa- 
tions. These particular new coordinates are drawn in Figure 23.2. This com- 
pletes the discussion on how to find the new coordinates; the last step is to find 
the new equation. 


n = y - 2x = constant 


E = y + 2x = constant 


FIGURE 23.2 The new characteristic coordinates for Ux — 4u, + u, = 0. 


The last part is very easy: All we must do to find the canonical equation is 
take the new coordinates &(x, y) and n(x, y) and substitute them into the equation 


Au, + Bu, + Cu,, + Du, + Eu, + Fu = G 


Before we complete this lesson, let’s apply the general procedure to see how 
it works in a specific example. 


Rewriting the Hyperbolic Equation y?u, — x?u,, = Oin 
Canonical Form 


Suppose we start with the equation 
y*u,, XU, = 0 x0 y>0 


which is a hyperbolic equation in the first quadrant. We consider the problem 
of finding new coordinates that will change the original equation to canonical 
form for x and y in the first quadrant. 


STEP 1 Solve the two characteristic equations 


dy B+ VB — 4AC ~ x 

dx 2A y (remember, this step is equivalent 
dy S B — B? — 4AC Ox to setting A = C = 0) 

dx — 2A y 
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Integrating these two equations by the ODE technique of separating variables 
gives the implicit relationship (we can't actually solve for y explicitly in terms 
of x here) 


constant 
constant 


y? + x 


and, hence, the new coordinates ¢ and v are 


cay ex 
ne yt 


These two new coordinates are drawn in Figure 23.3. 


y £ = constant (Hyperbolas) 


n = constant (Circles) 


FIGURE 23.3 New characteristic coordinates. 


This gives us the new coordinates; in order to find the new equation, we compute 


A=0 this must be true; we set it equal to zero and solved for and n 
B = 2A&n, + Blé, + Em.) + 2CEn, = —16xy 

C=0 same here; we set it equal to zero 

D = Ab. + BE, + CC, + DE + EE, = —2(x^ + y?) 

E = Ana + Bn, + Cn, + Dn, + En, = 2y? - x?) 

Ea B= 

G=G=0 


and substitute them into the equation 
Au, + Bu,, + Cu,, + Du, + Eu, + Fu = G 
to get 


Nisi dus y Ju; + (y? — x’)u, 
un = 8x22 


STEP 2 Finally, solving for x and y in terms of & and «, we get 
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23.8 E nue — Su, 
= ^ = ow) 


This is the end of the line; we now know how to find the new coordinates and 
the new equation. 


NOTES 


1. The general hyperbolic equation actually has two canonical forms; the other 
one can be found by making yet another transformation 


Q 


p 


Ho gu 
Q 
p- 
AA 
3 

N a. 

Mo 

YY Str 

| + 


and rewriting the first canonical form in terms of a and 8. Doing this for 
equation (23.8) gives 


Ug = UQ0; + Ugh, = Ua + Ug 
u, = UAn + UgB, = Ua — Ug 
Uey = Usa, + Mapa + Upan + UpeBy = Uaa — Usp 


and hence, 


— Bu, —au 
(23.9) Uxa ^ Ugg = E 


If we wish, we could solve for the a and 8 coordinates in terms of the 
original x and y; in other words, 


0 - x) + Ox) 


= E: 2y? 
B-&£-m-20(^-»x)-( tx) 


= —2y? 
2. One question the reader may ask is why someone would be interested in 
classifying and transforming a PDE into canonical form. 

(a) The three major classifications of linear PDEs as hyperbolic, para- 
bolic, and elliptic equations essentially classify physical problems 
into three basic physical types: wave propagation, diffusion, and 
steady-state problems. The mathematical solutions of these three 
types of equations are quite different. 

(b) Much of the theoretical work on the properties of solutions to hy- 
perbolic problems assumes the equation has been written in ca- 
nonical form. In other words, it’s the equation 


Use — Ung = WE, N, U, Up Un) 
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that is studied. If we have an equation and want to study properties 
of the solution, we must convert it to canonical form and use existing 
results. 

(c) Many computer programs have been written to find the numerical 
solution of the canonical hyperbolic equation. The function ®(¢, n, 
U, Us, U,) is fed into the computer in the form of a subroutine so it 
is necessary to convert the PDE to canonical form before starting. 
After finding the solution in terms of the new coordinates, we can 
always convert back to the original coordinates. 


PROBLEMS 


1. State whether the folowing PDEs are hyperbolic, parabolic, or elliptic: 
(a) Uy, T Uy = 0 


(b) u, = u,, + u, + hu 
i Us, + 3u,, = sin x 
Ue. = 


1 
(e) U, A FL + p2 = f(7,8) 


Verify equations (23.4), (23.5), and (23.6) in the lesson. 
Verify that the equation 


w M 


Ju, + Tu, + 2u,, = 0 


is hyperbolic for all x and y and find the new characteristic coordinates. 
4. Continue with problem 3 by finding the new canonical equation 


Uc, = P(E, N, U, Us, Un) 
5. Continue with problem 4 by finding the alternative canonical form 
Usa — Uge = F(a, B, u, u, Ug) 
6. Find the new characteristic coordinates for 
u,, + 4u,, = 0 
Solve the transformed equation in the new coordinate system and then 


transform back to the original coordinates to find the solution to the original 
problem. 
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LESSON 24 


The Wave Equation in Two and 
Three Dimensions (Free Space) 


PURPOSE OF LESSON: To solve the initial-value problem 


—o «c x«o 
PDE u, = C[u,, + uy, + U,,| —o«cyc«o 
—00« z «o 


u(x,y,z,0) = (x,y,z) 
Ies peer m p(x, y,Z) 


in three dimensions and show how this solution satisfies Huygen’s principle. 
The method of descent is then used to solve the corresponding problem 
in two dimensions 


-—-O<X¥< 
—0 «c y<% 


PDE u, = c[u,, + uy | 
ICs d = (x,y) 


u(x,y,0) = (x,y) 

It is then shown that the two-dimensional solution does not satisfy Huygen’s 
principle. Finally, the method of descent is used once more to show that 
the one-dimensional version of this problem has the D’Alembert solution 
(which we have seen before). 


Earlier, we discussed the infinite vibrating string with ICs and showed how it 
gave rise to the D’Alembert solution. The reader should realize that another 
application of the one-dimensional wave equation would be in describing plane 
waves in three dimensions. For instance, sound waves that are reasonably far from their 
source are essentially longitudinally vibrating plane waves and, hence, are described by 
this equation. The general situation is 

1. One-dimensional waves are called plane waves 

2. Two-dimensional waves are called cylindrical waves 

3. Three-dimensional waves are called spherical waves 
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In other words, the one-dimensional wave equation might describe either plane 
waves in higher dimensions or else a one-dimensional vibrating string. The 
problem of this lesson is to generalize the D'Alembert solution to two and three 
dimensions. 


Waves in Three Dimensions 


We start by considering spherical waves in three dimensions that have given ICs; 
that is, we would like to solve the initial-value problem 


—oo« x« cx 

PDE uU, = C(U + uy, + Uz) -æ < y<% 
-0 < z« o 

(24.1) 


ICs u(x,y,z,0) = (x,y,z) 
u(x,y,z,0) = (x,y,z) 
To solve this problem, we first solve the simpler one (set 6 = 0) 


PDE u, = c V?u 


u(x,y,z,0) = 0 
i ert = (x,y, Z) 


(24.2) 


where V? is the differential operator 


— + 
ax? ü dy? = az? 
This problem can be solved by the Fourier transform and has the solution 


(24.3) u(x,y,z,t) = hp 


where y is the average of the initial disturbance yy over the sphere of radius ct 
centered at (x,y,z); that is, 


E 1 re l l p 
y = Anc h w(x + ct sin d cos 0, y + ct sin ó sin 0, 
z + ct cos >) (ct) sin $ dð db 


The arguments of y range over the surface of the sphere as 0 and 6 range from 
[0,27] and [0,7], respectively (Figure 24.1). 
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Solution at the center 
of the sphere 


| Spherical coordinate 
x =r sin ġ cos 0 

y y 7rsin $ sinO 

z-rcosó 


FIGURE 241 Solution as the average of initial disturbances on a sphere. 


The interpretation of this solution is that the initial disturbance wy radiates out- 
ward spherically (velocity c) at each point, so that after so many seconds, the 
point (x,y,z) will be influenced by those initial disturbances on a sphere (of 
radius ct) around that point (Figure 24.2). 


Initial 
disturbance 
propagating 

outward 


y 


7 


~ 


S / ^ 


FIGURE 24.2 Initial disturbance v propagating outward from each point. 


The actual value of the solution (24.3) would most likely have to be computed 

numerically on a computer for most initial disturbances. It might be interesting 

for the reader to try to evaluate this solution for a few simple functions wy. 
Now, to finish the problem. What about the other half; that is, 


(24.4) PDE Hy = c’ V?u (x, y,z)eR? 
u = d 
ICs M -0 


This is easy: A famous theorem developed by Stokes says all we have to do to 
solve this problem is change the ICs to u = 0, u, = 6, and then differentiate 
this solution with respect to time. In other words, we solve 
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(24.5) PDE 


to get u = th and then differentiate with respect to time. This gives us the 
solution to problem (24.4) 


ð _— 
= — Ít 
u = = [19] 
We can see how this works for the one-dimensional wave equation where the 
solution (D'Alembert's solution) of (24.5) is 
u(x,t) = E "^ e) ds 
Á 2c x—ct 
Therefore, if we differentiate this equation (Leibnitz rule, problem 7), we get 


ult) = ZOE + e) + ex - er] 


which is the solution of (24.4). 
Knowing this, we now have the solution to our general three-dimensional 
problem 


PDE u, = CV?^u — (xyz)eR? 
u=o 
ICs M i 


It's just 
o rie 
u(x,y,z,t) = th + 3 [to] 


where ¢ and y are the averages of the functions b and y over the sphere of 
radius ct centered at (x,y,z). 

This is known as Poisson's formula for the free-wave equation in three di- 
mensions, and it is the three-dimensional generalization of the D'Alembert 
formula. The most important aspect of the Poisson formula is the fact that the 


two integrals in $ and v are integrated over the surface of a sphere, which 
enables us to make the following important interpretation of the solution. When 
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time is / = ¢,, the solution u at (x,y,z) depends only on the initial disturbances 
$ and y on a sphere of radius ct, around (x,y,z) (Figure 24.3). 


(x, y, z) 


Center of sphere 


FIGURE 24.3 Diagram showing how initial disturbances affect a point (x,y,z). 


Suppose now the initial disturbances $ and y are zero except for a small sphere 
(see Figure 24.3). As time increases, the radius of the sphere around (x,y,z) 
increases with velocity c, and so after t, seconds, it will finally intersect the initial 
disturbance region, and, hence, u(x,y,z,t) becomes nonzero. For t, < t < t, the 
solution at (x,y,z) will be nonzero, since the sphere intersects the disturbance 
region, but when ¢ = ¢,, the solution at (x,y,z) abruptly becomes zero again. In 
other words, the wave disturbance originating from the initial-disturbance region 
has a sharp trailing edge. This general principle is known as Huygen’s principle 
for three dimensions, and it is the reason why sound waves in three dimensions 
stimulate our ears but die off instanteously when the wave has passed. It turns 
out that waves always have sharp leading edges, but the trailing edges are sharp 
only in dimensions 3, 5, 7, . . . We already know from the D’Alembert solution 
that the initial disturbance 


u(x,0) = (x) 
u(x,0) = Y(x) 
in one dimension does not have a sharp trailing edge {since the D’Alembert 
solution integrates from (x — ct) to (x + ct)]. 
We will now show that the Huygen's principle does not apply to cylindrical 


waves. This situation occurs when a water wave originates from a point where 
the trailing edge of the wave is not sharp but gradually damps to zero. 


Two-Dimensional Wave Equation 


To solve the two-dimensional problem 
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PDE uy, = (Us + U,y) p : : p E 
(24.6) 
ICs ber = (x,y) 

u(x,y,0) = (x,y) 


we merely let the initial disturbances ó and v in the three-dimensional problem 
depend on only the two variables x and y. Doing this, the three-dimensional 
formula 


PNE MN 
u= th + = [tb] 


for u will describe cylindrical waves and, hence, give us the solution for the two- 
dimensional problem; this technique is called the method of descent. Carrying 
out the computations (which are by no means trivial), we get 


zd [. rdi 
u(x,y,t) = 2mclJo Jo Vict — r i 


ð 1 27 fct (x',y') 
x'=x+prcos0 «Sad _ oY) a ae 
y =y+rsin@ a o Jo Vey — r rar 


This is the solution for the free-wave equation in two dimensions, and although 
we would probably have to evaluate it numerically, it has an interesting inter- 
pretation in terms of Huygen's principle. Note that in this solution, the two 
integrals of the initial conditions @ and w are integrated over the interior of a 
circle (the key word is interior) with center at (x,y,z) and radius ct. In other 
words, if we analyze what this means in a manner similar to the three-dimensional 
case, we see that initial disturbances give rise to sharp leading waves, but not 
to sharp trailing waves. Thus, Huygen's principle doesn't hold in two dimensions. 

Finally, if we assume the initial conditions $ and y depend only on one 
variable, this gives rise to plane waves and, hence, the preceding equation de- 
scends one more dimension to the well-known D'Alembert solution 


xctct 


u(x,t) — = er + ct) d d(x — ct)] + 2 dien W(s) ds 


Again, carrying out the actual computation in the method of descent is nontrivial. 
Note in the D'Alembert solution, the initial position gives rise to sharp trailing 
edges, but the initial velocity does not. In other words, one dimension is a little. 
unusual in that the initial position satisfies Huygen's principle, but the initial 
velocity does not. We generally say here that Huygen's principle does not hold 
in one dimension. 
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NOTES 


The method of descent wasn't illustrated in detail in this lesson, since we didn't 
show how the lower-dimensional integral could be constructed from the higher- 
dimensional one. The actual calculus can be found in reference 2 of Other 
Reading. The general idea is that the solutions of problems in higher-dimensional 
spaces can be used to find the solution to problems in lower-dimensional ones 
by assuming certain boundary and initial conditions are independent of certain 
variables. The reader should realize that this isn't the only problem to which 
the method of descent applies. 


PROBLEMS 


1. Show that in one dimension, we can find the solution of 


PDE u, = cu, —o-«cx«o 
u(x,0) = (x) 
me i = 0 


by differentiating with respect to ¢ the solution of 


PDE u, = Cu, 


(x,0) = 0 
s a = (2) 


2. Apply the results of problem 1 to find the solution of 


PDE U, = Uy, O< 
u(x,0) = x 
= ee = 0 


3. Illustrate by picture and words the spherical wave solution of the three- 
dimensional problem 


PDE u, = Vu (x, y,z)eR? 


ICs En X boy" gy 1 
d 0 elsewhere 


4. (To be worked with problem 3.) What is the two-dimensional solution of 
the analagous cylindrical-wave problem 
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PDE U, = CVU, (x, y)eR? 


ICs p "ma M" eeet 
|. 10 elsewhere 


5. (To be worked with problem 3.) What is the one-dimensional solution of 
the analogous plane wave problem 


PDE U, = cu -x <x <x 


xx 


ICs oor ang x} <1 
HAMS) = 10 elsewhere 


6. What is the physical interpretation of why Huygen’s principle does not hold 
in two dimensions? 
7. Use Leibniz’s rule 


a(t) a(t) 
9 [rend | EEN de + ORR. - FOF. 


at Jfo 


to differentiate the integral 


1 x+ct 


(s) ds 


2c X —ct 


with respect to f. 


OTHER READING 


1. Partial Differential Equations by P. Garbedian. John Wiley & Sons, 1964. An ex- 
cellent account of Huygen's principle; the book is considerably more advanced than this 
lesson. 


2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Macmillan, 
1963; Dover, 1990. An excellent reference for problems in mathematical physics. 
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ussoN 25 


The Finite Fourier Transforms (Sine 
and Cosine Transforms} 


PURPOSE OF LESSON: To introduce two new integral transforms 


(finite sine and cosine transforms) 
2 L 
T | f(x) sin (nmx/L) dx (finite sine transform) 


J L 
5 [ f(x) cos (nmx/L) dx (finite cosine transform) 


+ > C, cos (nmx/L) (inverse cosine transform) 


n-l 


f(x) = 


f(x) = 9 S, sin (nux/L) (inverse sine transform) 
n=l 
C, 
2 


and to show how to solve boundary-value problems (particularly nonhomo- 
geneous ones) by means of these transforms. Earlier, we learned about 
the regular Fourier and Laplace transforms and how problems are solved 
by transforming partial differential equations into ODEs. The usual Fourier 
transform requires the variable being transformed to range from — ^ to 
œ; hence, it is used to solve problems in free space (no boundaries). In 
this lesson, we show how to solve boundary value problems (with bound- 
aries) by transforming the bounded variables (first time we've done this). 


First, let's forget the motivation; let's just define the transforms, their inverses, 
and use them. We will talk about why they work later. In short, however, 
transform methods can be thought of as resolving the functions of the problem 
into their various frequencies—solving an entire spectrum of problems for each 
frequency and then adding up the results. 

We first start with a function f(x) defined on an interval [0, L]. The finite 
sine and cosine transforms of this function are defined by 
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L 
Finite sine transform Sif] = S, = | f(x) sin (nmx/L) dx 
0 
n=1,2,... 


2 L 
Finite cosine transform c] = C, = L | f(x) cos (nmx/L) dx 
n=0,1,... 


The reader will note that these transforms do nothing more than transform a 
function into the Fourier sine and cosine coefficients. The inverse transforms 
of these transforms are the Fourier sine and cosine series 


fix) = > S, sin (nnx/L) 


Inverse cosine transform | /(*) = 


Inverse sine transform 


Note that the summation in the inverse cosine starts at n = 0, while the inverse 
sine starts at n = 1. 


Examples of the Sine Transform 


0 n even 


1 
f(x) =1 0zxx1 S, = S[1] = 2| sin (nmx) dx = [es odd 


See the graphs of f(x) and its transform in Figure 25.1. 


f(x) Sa 7 Sl 


S. = 0 n even 
i 4/nr nodd 


1 12 3 45 6 7 
FIGURE 251 Graph of f(x) = 1 and its transform. 


The inverse transform would be 
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fx)21-2 - y P 1 sin (nx) 


Do you know what the graph of this function would be outside the interval [0,1]? 
Think about it. Note, too, that the sine transform of f(x) is a function defined 
only at the positive integers (that is, it is just a sequence of numbers). In other 
Words, the finite sine and cosine transforms transform functions into sequences. 


Properties of the Transforms 


Before solving problems, we must derive some of the useful properties of these 
transforms. 

If u(x,t) is a function of two variables, then (note we're transforming the x- 
variable) 


L 


S[u] = S,(t) = Z f u(x,t) sin (nmx/L) dx 


L 


C[u] = C,(t) = 2 | u(x,t) cos (nmx/L) dx 


0 


(Note that we transformed the x-variable and now have a sequence of functions 
in time alone.) 
What about derivatives? Here are a few of the more useful laws: 


su) = CH su, = EE 


Siu] = —[na/LPS[u} + = [u(0,t) + (-1)*'u(L,£)] 


Clue] = — [nmi LPClu] — 7 [u,(0,0 + (= uL] 


Solving Problems via Finite Transforms 


solution of a Nonhomogeneous BVP via the Finite Sine 
Transform 


Consider the nonhomogeneous wave equation 


PDE uU, = U + sin (mx) 0<x<1 0<t<æ 
u(0,t) = 0 
BCs Puis 0ct«o 
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0zxx1 


(x,0) = 1 
ICs Bà Es 


To solve this problem, carry out the following steps: 

STEP 1. (Determine the transform) 

Since the x-variable ranges from 0 to 1, we use a finite transform. Also, you will 
see why, in this case, we use the sine transform. We could solve this problem 
with the Laplace transform by transforming t (it would involve about the same 


level of difficulty as the finite sine transform). 


STEP 2. (Carry out the transformation) 
Here, transforming the PDE, we get [we will call S(t) = S[u] for convenience] 


S[u,] = S[u,.] + S[sin (nx)] 
Using the identities for the sine transform, we have 


a’S,,(t) 
dt? 


— (nmyS,(t) + 2nn[u(0,t) + (—-1)*!u(1,0] + D,(t) 
— (nmyS,(t) + D,(t) 


where 


D,(t) = S[sin (mx)] = H n i i RE 


(these are the coefficients in the Fourier sine series) 


If we now transform the initial conditions of the boundary-value problem, we 
will arrive at the initial conditions for our ordinary differential equation 


S[u(x,0)] = 5,(0) = m irs 
S[u(x,0)] = an = 0 


So, solving our new initial-value problem(s) 


= 
uon 

= 

W 
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4/nm n = 1,3, 
5,0) = | 0 n = 2,4, 
ICs 3548 
AO) _ 9 n = 1,2,3, 
dt 
we have 
S,(t) = A cos (mt) + (1/1)? 
where 
A = 2 - — = 1.17 
T 


0 n = 2, 4,... 
= 44 
5.) — cos (nmt) n 3:5. 5 
nm 


Hence, the solution u(x,t) of the problem is 


u(x,t) = [A cos (mt) + (1/m)?] sin (mx) + = 9, ——— 


cos [(2n + 1)mt] sin [Zn + 1)mx] 


NOTES 


1. In order to apply the finite sine or cosine transform, the BCs at x = 0, L 
must both be of the form 


«dà 7 f ry (use sine transform) 


u,(0,t) = f | 
u(L,t) = g(t) (use cosine transform) 


In other words, the BCs u(0,t) = f(t) and u,(L,t) = g(t) wouldn't work. 
Also, BCs like u,(0,¢) + hu(0,t) = 0 don't apply. There are other transforms 
for BCs like these; refer to the generalized sine and cosine transforms in 
reference 2 of Other Reading. 

2. Inorder to apply the finite sine and cosine transforms, the equation shouldn’t 
contain first-order derivatives in x (since the sine transform of the first 
derivative involves the cosine transform, and vice versa). 
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3. The finite sine- and cosine-transform method essentially resolves all func- 
tions in the original problem (like z,, u,,, the ICs, BCs) into a Fourier sine 
or cosine series, solves a sequence of problems (ODE) for the Fourier 
coefficients, and then adds up the results. 


PROBLEMS 


1. Solve the diffusion problem with insulated boundaries; that is, 


PDE U, = U,, 0cx«1 0<t<o 
u,(0,t) = 0 
BCs br -0 0<t<o 
IC u(x,0) = 1 + cos (wx) + 0.5 cos (37x) O0xxx1 


2. Solve the general problem 


PDE u, = a7u,, + bu + f(x,t) 0cx«1 0<t<o 
u(0,t) = 0 
BCs PY -0 0<t<o 


IC u(x,0)=0 Osxs1 


3. Derive the basic laws for S[u,] and C[u,,] that were given on page 198. Can 
you see why it would be hard to solve differential equations that contained 
first derivatives u, in the equation? 

4. What is the finite sine transform of f(x) = sin (mx) + 0.5 sin (37x)? Graph 
the sine transform. Pick L = 1 in the transform. 

5. What is the cosine transform of the function f(x) = x, 0 < x < 1? What 
would the graph of the inverse transform look like for all values of x. [You 
know it reproduces f(x) = x for 0 < x < 1, but what about outside the 
interval [0, 1]?] 

6. Solve the problem 


PDE u,=u,, + sin(9m) O<x<1 0<t<a 
BCs PE =? 0< t<% 


IC u(x,0) = sin (vx) 0zxxl 
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OTHER READING 


1. Partial Differential Equations by Tyn Myint-U. Elsevier, 1973. Several examples are 
worked by means of the finite sine and cosine transforms. This book has good problems 
and is clearly written. 

2. Operational Mathematics by R. Churchill. McGraw-Hill, 1972. An excellent book 
covering the topic of integral transforms and their applications; more advanced than this 
book, but useful to anyone seriously interested in the technique. 
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LESSON 26 


superposition (The Backbone of 
Linear Systems 


PURPOSE OF LESSON: To introduce the idea of superposition and 


show how it can simplify problems by breaking them into subproblems, 
enabling us to solve the subproblems one at a time and then add the results 


to obtain the solution of the original problem. It is also shown that the 
two basic methods for solving linear equations, separation of variables and 
integral transforms, use the principle of superposition. 


For an engineer who wishes to find the response u to a linear system from an 
input f, a common approach is 

1. Break f into elementary parts, f = È fy. 

2. Find the system response u, to f,. 

3. Add (superimpose) the simple responses u, to get u = X u,. 
It turns out if the system is /inear, then the sum u is the response we get if the 
function f were imputted directly; this is the principle of superposition (Figure 
26.1). 


Linear 
system 


Could be a linear 


PDE Lu = f where L 
is a differential operator; 
f is the input and u 
the output 


FIGURE 26.1 Basic idea of superposition. 


We can use this basic idea to solve initial-boundary-value problems by break- 
ing the problem into subproblems, solving each subpart individually, and then 
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adding the results of each part (of course, the differential equation and the 
boundary conditions must be linear). 


Superposition Used to Break an IBVP into Two Simpler 
Problems 


Suppose we have the linear problem (call it P) 


PDE u, = u, + sin (mx) O<x< 1 0<t< æ 
u(0,t) = 0 
(P) BCs uy Zo O«<t<e 


IC u(x,0) = sin (27x) 0xxxl 


Here, we have a nonhomogeneous heat equation, so separation of variables is 
not a viable method of attack. We could, of course, use the finite sine transform 
on the variable x or the Laplace transform on t, but still another idea would be 
to consider two subproblems 


PDE u, = u,, + sin (mx) 
u(0,t) = 0 
(P1) BCs py eo 


IC u(x,0) = 0 


and 
PDE U, = Ux 
u(0,t) = 0 
(P2) BCs MM -0 


IC u(x,0) = sin (27x) 


These two problems can be solved individually with a little effort, and it should 
be clear here that the sum of the solutions to P, and P, is the solution to the 
original problem P; that is, 


1 
m 


u(x,t) = — (1 — e7*") sin (ux) + e- 7" sin (2mx) 


Solution to P, Solution to P, 
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In general, we should be able to show that the solution to 


(0 Uy, + f(x, 
u(0,t) = 0 
u(1,t) = 0 
u(x,0) = (x) 


is the sum of the solutions to 


U, xx Uu is fo 


u(0,t) = 0 
u(1,t) = 0 
u(x,0) = 0 
and 
U, = Uu,, 
u(0,t) = 0 
u(1,t) = 0 


u(x,0) = (x) 


Separation of Variables and Integral Transforms as 
Superpositions 


We may not think of superposition when using separation of variables or integral 
transforms, but, in fact, we are using the idea of an infinite superposition. In 
separation of variables, we generally break down the initial conditions into an 
infinite number of simple parts and find the response to each part. We then sum 
these individual responses to find the solution to the problem. 

On the other hand, integral transforms also use superposition, for instance, 
let's show how the finite sine transform uses this principle. Consider the non- 
homogeneous heat equation 


PDE u, = Uu, + f(x,t) 0<x<1 0<t<% 
u(0,t) = 0 
BCs ey -0 0cr«o 


IC u(x,0) = 0 0xxx1 


and consider its solution by use of the finite sine transform. What we're really 
doing is resolving the input f(x,t) into components, finding the response U, due 
to each component, and adding these responses. Mathematically, it may not be 
quite so obvious, but watch carefully. We start by expanding the PDE 
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Uu, = Ux RE f(x, t) 


into a Fourier sine series 

(26.1) YX A, sin (nmx) = S B, sin (anx) + YF, sin (nux) 
n=1 n=1 n=1 

where 


A,(t) = 2 | m sin (nox) dx 
B,(t) = 2 f E sin (nmx) dx 


F(t) = 2 [ flat) sin (nax) dx 


Note that the coefficients A,, B,, and F, are actually functions of t, since we 
started with functions of x and t. Note, too, that we have resolved the input 
f(x,t) into simple components F,(t). What we would like to find is the response 
U,(t) to each F,(t). Then we would add the U,(t) to get the solution u(x,t). 
To find the simple responses U,(t), we must take our resolved PDE (26.1) 
and perform a little calculus on the coefficients A,(t) and B,(t), so that the 
integrands contain u instead of u, and u,,. Integration by parts gives us 


A,(t) = 2 fu, sin (nmx) dx = 5 |2 [wee sin (nax) d 7 d 


B,(t) = 2 f P sin (anx) dx = —(n7)?U,(t) *2nv [u(0,t) + (—1)'*!u(1,0] 


where U,(t) is the sine transform of u(x,t). Substituting our BCs 


u(0,t) = 0 
u(1,t) = 0 
into this last equation, we have 
B,(t) = — (nnyU,(t) 


and, hence, the resolved PDE (26.1) becomes 
Y [U', +(n2)?U, — F,(t)] sin (nx) = 0 
n=] 
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Since this is an identity in x, the coefficients must be zero; that is, 
U', + (nmt) U, = F(t) 


Hence, we have our input-output relationship between F, and U,,. Before we 
can solve for U,(t), however, we must go to the IC 


u(x,0) = 0 


If we expand u(x,0) as a sine series and set it equal to zero, we get 
S. U,(0) sin (nux) = 0 
n-l 
Hence, our initial conditions are 
U,(0) = 0 n=1,2,... 


We have now resolved our original IBVP into the simple input-output problems 


ODEs  U/(t) + (nm)? U(t) = FK) 
ICs U(020 n=1,2,... 


We can solve each of these problems by using an integrating factor (or Laplace 
transform, if we like); in any case, we get 


t 
UO) = ec | eE, (a) dr 


We have now found the responses U,(t) to the simple inputs F,(t). The final 
step, as the reader knows, is to sum these simple responses 


u(x,t) — > U,() sin (nmx) 


to obtain the solution to the original problem. The reader should note that each 
U,(t) is weighted by sin (nmx). These, of course, are the same weights used 
when f(x,t) was decomposed into F,(t). 


NOTES 


In the finite sine transform, the resolutions were infinite series, whereas in most 
other integral transforms, the resolutions are integrals (continuous resolutions). 
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It would be interesting if the reader carried out a similar superposition inter- 
pretation for the problem 


PDE u, = U,, —o«x«o 
IC u(x,0) = o(x) -x « xy « c 


for the exponential Fourier transform (on x). This is essentially what was done 
in lesson 12 when we solved this problem with Green's function. 


PROBLEMS 


1. Show that if u, and u, are the solutions to problems P, and P, in the lesson, 
then u, + u, satisfies problem P. 
2. Solve the IBVP 


PDE uU, = Uu, + sin(3mx) O<x<1 0<t<o 


u(0,t) = 0 
BCs fey -0 0< t< 
] u(x,0) = sin (mx) 


by superposition (each subproblem can be solved in any manner you like). 
3. Suppose u, and u, are solutions of the following equations; for which equa- 
tions is 4, + u, a solution? 
(a) u, = wu, 
li. poe 
(c) wu = eu, 
(d) U, = Ux T u? 
What conclusions can you reach from your answers? 
4. Find four initial-boundary-value problems whose solutions sum to the so- 
lution of the following problem: 


~ 

og 

— 
= 
ll 


uU, = u,, + f(x, t) 0<x<1 O<t<« 


u(0,t) = g,(t) . 
ug) -g() OS'S 


u(x,0) = d(x) Osx 
5. Solve the IVP 


ODE  U',(f) + (nxYU,(t) = F,(2) 
IC U,(0) =0 
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Can you verify the solution? 
6. Suppose u, and u, both satisfy the linear homogeneous BCs 


u,(0,t) + h,u(0,t) = 0 
u,(1,t)  hyu(1,)) = 0 


Does u, + u, also satisfy the BCs? 


OTHER READING 


A First Course in Partial Differential Equations by H. F. Weinberger. Ginn and Company, 
1965. This text contains a good section on linearity and superposition; it also has a large 
section on complex variables. See Chapter 2 in particular. 
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LESSON 27 


First-Order Equations (Method of 
Characteristics) 


PURPOSE OF LESSON: To introduce the notion of first-order partial 


differential equations (so far, we've studied only second order) and intro- 
duce an important technique for solving initial-value problems (method of 
characteristics). The problem we will solve is the initial-value problem 


PDE a(x,t)u, + b(x,t)u, + c(x,t)u = 0 —00 « x « 0 
0O<t<o 
IC u(x,0) = (x) —o«cx«o 


Note that this is the first time we've solved problems with variable coeffi- 
cients. It turns out that if we change coordinates from (x,t) to appropriate 
new coordinates (s,7) (characteristic coordinates), then our differential 
equation becomes an ordinary differential equation. Hence, we solve the 
ODE to find u(s,t), and, then, the last step is to plug in the values of 
s and 7 in terms of x and t to get u(x,t). 


If the reader recalls, when we solved the diffusion equation 

U, = a7u,, — VU, -© <x <% 0crco 
the constant o? stood for the amount of diffusion, while v stood for the velocity 
of the medium. Hence, if a = 0 (no diffusion), it is clear (since we only have 


convection) that the solution will travel along the x-axis with velocity v. In other 
words, if the initial solution is u(x,0) = (x), then the solution to 


would be u(x,t) = o(x — vt). 
So (one interpretation) we can think of the first-order equation 


a(x,t)u, + b(x,t)u, = 0 
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as the concentration along a stream where the velocity is given by 
v = —a(x,t)/b(x,t) 


Of course, if a(x,t) and b(x,t) are constants, then we have traveling wave so- 
lutions; on the other hand, if a(x,t), b(x,t) change in x and t, then the stream 
velocity varies as we go along the stream and with time (the reader can see that 
the initial curve can get very distorted). 

So much for the convection analog; let's get back to our basic problem 


PDE a(x,fu, + b(x,t)u, + c(x,t)u = 0 -æ <x <% Üct««c 
IC u(x,0) = o(x) -© <x <% 


The solution to this (linear first-order homogeneous) equation is based on a 
physical fact, namely, that an initial disturbance at some point x propagates along 
a line (curve) in the tx-plane (called a characteristic). See Figure 27.1. 


I 
8 


s varies along the 
characteristics (Ranges 
from zero to infinity 
starting at the initial 
curve) 


Characteristics 
(Energy propagates along these lines) 


T is a constant 
along each 
characteristic 


s = Constant 
on this line 
x 


T changes along the initial curve 


FIGURE 27.1 The initial solution at x affects the solution only along a line in 
the xt-plane. 


This phenomenon contrasts with many other equations (such as the heat equation 
u, = u,,) where an initial disturbance at a point affects the solution everywhere 
else later in time. Also, if the reader recalls, the initial-position disturbance of 
the violin string at a point x affected the solution along two lines in the tx-plane 
(corresponding to two moving waves). See Figure 27.2. 

Solving this IVP, we get 


(Two characteristics) 


Disturbance of initial string 
propagating along two lines 
in the wave equation 


x 


Xo 


FIGURE 27.2 Initial disturbance u(x, 0) at a point giving rise fo two waves. 
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With this in mind, the idea is to introduce two new coordinates s and t (to replace 
x and ¢) that have the properties 


s will change along the characteristic curves. 
1 will change along the initial curve (most likely the line t = 0). 


First, consider the new coordinate s. By choosing s having the above property, 
the PDE | 


a(x,t)u, + b(x,t)u, + c(x,D)u = 0 
is transformed into the ODE 


du 
d: + c(x,f)u = 0 


Of course, the question becomes how to find these characteristics? The answer 
is simple; we pick the characteristic curves {[x(s),t(s)]: 0 < s < œ} so that 


dx 
des a(x,t) 
dt 
ds b(x,t) 


By doing this, it is clear that 


du dx dt 


duy t Migg = Met, + bdu 


In other words, along the curves ([x(s),:(s)]: 0 < s < œ}, the PDE becomes an 
ODE. We can make these ideas clear with an example. 


Example 
Suppose we want to solve the following IVP with constant coefficients: 


PDE u, +u + 2u = 0 -x <y <x O<t<a 
IC u(x,0) = sin x -o <y <x 


STEP 1 Find the characteristics (along which the initial data propagate) 


—= ] —=]1 0csco 


Solving these equations gives (remember s is now the independent variable) 
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x(s) =S +, (s) =s +c, 
To evaluate the constants c, and c,, let s = 0, and referring to Figure 27.1, let 


x(0) =r 
t(0) = 0 


Doing this gives values of c, = t and c, = 0. Hence, our characteristic curves 
are 


To see what these curves look like in the /x-plane, we can eliminate s from these 
equations to get 


Xx -t=T -xX <T IX 


(for each value of t we get a straight line; for example, when 7 = 0, we get t 


— x). See Figure 27.3 
/ LIE 


Characteristic curves are straight lines 


f> T = constant 


$ = constant 


T varies along the initial line 


FIGURE 27.3 New coordinate system (s,1). 


STEP 2 Using this new coordinate system, we change the PDE to the ODE 
ODE — + 2u = 0 0cs«e 
IC u(0) — sin 1 
Solving this IVP, we get 


u(s,t) = sin T e~* 
(Note that we have written u as a function of both s and 1). 
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So this is the solution; the only problem is that it is in the wrong coordinate 
system. It would be better if we found u as a function of x and t. This is done 
in Step 3. 

STEP 3 We now solve the transformation 
X -—cpT t= S 
for s and 1 in terms of x and t. We have 
sS=t T=x-T 
Hence, our answer is 
u(x,t) = sin (x — the~* (check it) 


You can see that this means that the initial wave u(x,0) = sin x is moving 
to the right (undistorted in this case) and damping to zero (Figure 27.4). 


FIGURE 27.4 Solution moving with constant velocity to the right and 
damping fo zero. 


We now summarize what we have been saying. 


General Strategy for Solving the First-Order Equation 
Suppose we are given the IVP 


PDE a(x,t)u, + b(x,t)u, + c(x,tu = 0 —-co«x«o <t 
IC u(x,0) = f(x) —o«cx«o 


STEP 1 Solve the two ODEs (characteristic equations) 


dx dt 
p = a(x,t) FP = b(x,t) 
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Find the constants of integration by setting x(0) = 7 and (0) = 0. We now have 
the transformation from (x,t) into (s,7) 


X 
t 


x(s, T) 
t(s, T) 


STEP2 Solve the ODE 


du 


ODE ds 


+ c[x(s,t), t(s,t)Ju=0 O<s<cx 


IC u(0) = f(r) 


Note that we have substituted the values of x and t in terms of s and 1 into the 
coefficient c(x, t). 


STEP 3 After solving the ODE (with the ICs), we get a solution u(s,7). We 
must now solve for s and 7 in terms of x and t (from the transformation we found 
in Step 1) and substitute these values into u(s, 7). 

We now apply these steps in the following example (note variable coefficients) 


Another Example 


PDE xu, +u + tu = 0 -o <y <x 0<t<x 
IC u(x,0) = F(x) (an arbitrary initial wave) 


STEP 1 
a x has solution  x(s) = ce 
ds 
dt ; 
5 — ] has solution (s) =s +c, 


Letting x(0) = 7 and ¢(0) = O gives c, = t and c, = 0. Hence, the transformation 
into new coordinates is 


x= TO 
f=s 


STEP 2 Solve 


LE 0csco 
ds 
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u(0) = F(t) 
The solution is 
u(s,t) = F(v)e^? 
STEP 3 Solving for s and 7 gives s = t, 7 = xe~‘. Hence, the solution 
u(x,t) = F(xe^?)e-"? 
In other words, if the IC were u(x,0) = sin x, then the solution would be 


u(x,t) = sin (xe~)e~"? 


NOTE 


The reader may wonder why second-order PDEs were discussed first in this 
book and first-order equations second? From a mathematical point of view, we 
could have easily switched them around. However, since the techniques for 
solving second-order equations don’t rely heavily on first-order ideas and since 
second-order equations are more important, we decided to study second-order 
equations first. 

In the study of ordinary differential equations, the situation is different. The 
method of solution, the general theory, and so forth, follow naturally from first- 
to second-order equations, so text books always cover the first-order case first. 


PROBLEMS 


1. Solve the simple concentration problem 


PDE u + u, = 0 -c <x <x Ücrt«eo 
IC u(x,0) = cos x -o <x <£ 


What does the solution look like? Does it satisfy the PDE and IC? 
2. Solve the problem 


PDE xu, + tu, + 2u = 0 -x<x< c 1<t<a 
IC u(x,1) = sin x -x <x <x 


(note that time starts at t = 1 here). What do the characteristics look like? 
Plot the solution for different values of time. And, of course, check the 
answer. 

3. Solve the problem in higher dimensions (surface waves) 
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PDE au, + bu, + cu, + du = 0 -0% <x <0 
—0 < y<% 
0<t<o 


IC  u(xy0)2e-€*» —o <x <% 
—%0 < y <% 


where a, b, c, and d are given constants (check the answer). 
4. Solve 


u, + u, + tu = 0 —o«x«o 0cr«o 
u(x,0) = F(x) —0 <x <% 


Check the answer. 

5. Itis possible to specify the solution u on a curve other than the usual initial 
line t = 0. In fact, the differential equation doesn't have to involve the time 
variable at all (maybe u depends only on space variables). Try to solve the 
more general problem 


PDE u, t 2u, + 2u = 0 —o-«x«o 
—oo«yc«o 

Initial 

curve u(x,y) = F(x,y) on the curve C: y = x 


[the function F(x,y) is assumed given). 


OTHER READING 


Techniques in Partial Differential Equations by C. R. Chester. McGraw-Hill, 1971. A 
clear, concise description of first-order PDEs; an application to gas dynamics is given in 
Chapter 13. 
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LESSON 28 


Nonlinear First-Order Equations 
(Conservation Equations) 


PURPOSE OF LESSON: To introduce the idea of first-order nonlinear 


equations and to show how certain ones (so-called conservation equations) 
can be used to describe physical phenomena. One particular conservation 
equation 

u, + g(u)u, = 0 


along with initial conditions 


u(x,0) = (x) 


is used to describe the flow of automobiles along a freeway. This example 
points out that PDEs can be used to describe physical phenomena other 
than the usual ones in physics, biology, and engineering. It turns out that 
this particular nonlinear equation can give rise to discontinuous solutions 
(shock waves) that propagate along the road. 


One of the most useful partial differential equations in mathematics is the 


conservation equation 


This equation says that the increase of a physical quantity u, is equal to the 
change in flux —f, of that quantity across the boundary (flux is measured left 
to right). In fluid dynamics, u(x,t) could stand for the density of a fluid at x, 
while f(x,t) could be the flux (amount of liquid passing a point x at time ¢). In 
order not to get involved in the many details of fluid dynamics (such as as- 
sumptions of nonviscosity, incompressibility, and so forth), this lesson shows 
how the conservation equation can be used to predict traffic flow (flow of cars 
rather than the flow of water molecules). We first derive the conservation equa- 
tion. 
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Derivation of the Conservation Equation 


Suppose we have a stretch of highway on which cars are moving from left to 
right, and we assume there are no exit or entrance ramps. Suppose, too, we let 


u(x,t) = density of cars at x (cars per unit length at x) 
f(x,t) = flux of cars at x (cars per minute passing the point x) 


Then, it is fairly obvious that for a road segment [a,b], the change in the number 
of cars (with respect to time) is given by both of the following expressions: 


d b 
Change in the number of cars in [a,b] = d | u(x,t) dx 
and 


b 
Change in the number of cars in [a,b] = f(a,t) — f(b,t) = — | Js) dx 


(The last equation is a result of the fundamental theorem of calculus.) Setting 
these two integrals equal to each other, we have 


b 


E (x,t) dx = 2i a (x,t) dx 


Finally, since the interval [a,b] was arbitrary, we have the integrands themselves 
equal; hence, the one-dimensional conservation equation 


u + f, = 0 
If we carried out a similar analysis in two of three dimensions, we would have 


u.+f,+f, = 0 (Conservation equation in two dimensions) 
Ue dou poop (Conservation equation in three dimensions) 


Conservation Equation Applied to the Traffic Problem 


There is nothing very complicated about the equation u, + f, = 0; it's just that 
the equation has two unknowns! So, the question is, how do we use this equation 
and what are we looking for? 

In traffic control, the amount of cars passing a given point (flux) is generally 
found experimentally as a function of the car density u. In other words, exper- 
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iments can be performed to find f(u). It seems obvious that as the density u 
increases, the flux f increases (to a point, anyway). A typical model for traffic 
flow would be the equation 


f(u) = Au(1- u) 


See Figure 28.1. 


flu) = Au(1 - u) 


flux of cars 


f= 


0 1 = max density 
u = car density 


FIGURE 281 Typical flux versus density curve. 


Other flow rates could be 

1. f(u) = ku (linear flow rate) 

2. f(u) = wv (Quadratic flow rate) 

For a complete description of flow rates in traffic control, see reference 4 of the 
recommended readings. 

We are now ready to see how the conservation equation u, + f, = 0 can be 
applied to the traffic problem. To do this, we rewrite the change in flux f, as 
f. = (dffdu)u, (chain rule) and substitute it in the conservation equation. Doing 
this, we arrive at 


u+ Zu, = u, + g(u)u, = 0 


For example, if we find that the flux depends on the density using the equation 
f(u) = wu’, then the conservation equation becomes 


u, + 2uu, = 0 


Hence, if the initial density of the cars was u(x,0) = (x), then in order to find 
the density at any time t, we would solve the IVP 


PDE u, + 2uu, = 0 —00 « x <% 0cr«o 
IC — u(x,0) = ó(x) —o«x«o 


With these ideas in mind, we now solve a nonlinear initial-value problem. 
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The Nonlinear initial-Value Problem 
PDE u, + g(u)u, = 0 —o«cx«o O0<t<om 
IC u(x,0) = (x) —o«cx«o 


If the reader recalls the previous lesson, where we studied the convection equa- 
tion 


u, + vu, = 0 


the function u(x,t) represented the concentration in a stream that was moving 
with velocity v. We can see an analogy with the nonlinear equation 


u, + g(u)u, = 0 
where we can imagine a particle of water starting at the point x, and moving 
upstream or downstream with velocity g(u). Hence, after t seconds, the position 
x of the particle will be 
X = xo + g(u)t (Characteristic equation) 
Remembering that the concentration u(x,t) will not change along each charac- 


teristic, if we know the initial concentration u(x,,0), then the characteristic 
equation for x can be written 


x = xo + g[u(x,0)]t ^ [Characteristic curve starting from (x,,0)] 


For example, if we wanted to solve the initial-value problem (IVP) 


PDE u, + 3uu, = 0 


then to find the characteristic that starts from an initial point, say (2,0), we 
would write 


x = 2 + g[u(2,0)] 
= 2 + gly 
=2 +3t 
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Here, we can claim that the solution u(x,t) of our initial-value problem has the 
value one along the line x = 2 + 3t. That is u(2 + 3t,t) = 1 for all t > 0. Both 
the general characteristics and this specific example can be seen in Figure 28.2. 


t 


x = xo tglulxo, 0))t 


(Example of a 
characteristic 
starting from (2, 0)] 


{General characteristic 
starting from (xg, 0)] 


Solution remains 
u (x9 , 0) along 
this curve 


(xq, 0) 0 (2, 0) 
FIGURE 28.2 Characteristic curves of u, + g(u)u, = 0. 


It is now clear that by knowing these characteristic curves starting from each 
point (and knowing the solution doesn’t change along these curves), we can 
piece together the solution u(x,t) for all time t. We won't actually find the explicit 
equation for the solution u(x,t) in terms of x and t but will use our knowledge 
of the characteristics of the equation to solve some interesting problems. 


Traffic-Flow Problem 


We will now solve a traffic-flow problem where the flux is given by f(u) = u? 
and the initial density of cars is given. In other words, we have 


PDE u, + 2uu, = 0 —o«x«ov 0O<t<«x 
x <0 
IC u(x,0) = 41 -x 0<x<1 -c <y <x 
0 1xx 


See Figure 28.3. 


Flux » u? 


FIGURE 28.3 Initial density of cars moving left to right. 
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We begin by finding the characteristics starting from each initial point (x,,0). 
For x, « 0, the characteristics are 


x = Xo + g[u(xo,0)]t 
Xo + gil) 
Xo + 2t 


ll 


Solving for t, we get the lines | 
1 
t= 2 (x — xo) 
These straight lines can be seen in Figure 28.4. Now consider those initial points 
0 < x, < 1. Here, the characteristic curves are 


x = x, + glu(xs0)lt 


Xo + g[(1 — xot 
Xo + 2(1 — xot 


Again, solving for t, we have 


X — Xg 


= 20 — x) 


Finally, for 1 < x, « o, we have the characteristics 


x = xo + glu(xo 0))t 
xo + gl0]t 


= Xo 


which represents vertical lines starting at xy. The characteristics of this problem 
can be seen in Figure 28.4. 


t 


= Behind the shock wave= — /Shock wave 


Ahead of the shock wave 


T (1, 1/2) 
Solution is re 1/2 


constant along | 4 l 
characteristics. ps 7 f | 
1 J, 
t=—{ = = gee 
/ll. ^ 
rdi / d " 


Xg 0 Xo 1 


FIGURE 28.4 Characteristic of the equation u, + 2uu, = 0. 
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It is now clear how the traffic behaves for 0 « t « 1/2. Looking at Figure 
28.5, we can draw a few values of the solution for various values of time. 


u 


t=0 
x 
0 1 
u 
t - 0.16 
x 
0 1 
u 
t - 0.33 
x 
0 1 


FIGURE 28.5 Density of traffic at different values of time. 


Note that the characteristics run together starting at t = 1/2; hence, to find the 
solution past £ = 1/2, we must use another type of analysis. When characteristics 
run together, we have the phenomenon of shock waves (discontinuous solutions), 
and what we must ask is, how fast does the leading edge of the shock wave 
propagate along the road? A more detailed discussion of shock waves and further 
references can be found in reference 2 of the recommended reading for this 
lesson. Although not obvious, it turns out that the speed of the discontinuity is 
given by 


s = fü) — flu) 


Ug — UL 


where uz and u, are the values of the solution at the right and left of the wave 
front, and f(u4) and f(u,) are the values of the flux at these points. So, in our 
example, the speed of the wave front would be [remembering that f(u) = u?] 
0-1 
= = 1 


8 0-1 


This means that for t > 1/2, the wave front will move from left to right with a 
velocity of one. 
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The complete picture of the solution to 


PDE u, + 2uu, = 0 —o«cx«o 
1 xx0 

IC u(x,0) = 41 -x 0<x<1 
0 ]«x 


can be illustrated by Figure 28.5 


NOTES 


1. The shock wave in our example occurred because the flux grows very large 
as a function of the density u. If, on the other hand, the flux were given by 
f(u) = u, then the PDE describing the flow would be u, + u, = 0, and the 
solution would be an undistorted moving wave (the initial wave would just 
move to the right). If we think for a moment about what f(u) = u means, 
then it is obvious the solution will move in this manner. 

2. We can actually verify by direct substitution that 


u = [x — g(u)t] 
is an implicit solution of the nonlinear problem 


u, -g(uu, 0 5 -o«cx«o Oct«o 
u(x,0) = (x) —o«x«o 


For example, the implicit solution of the initial-value problem 


PDE u, + uu, = 0 
IC u(x,0) = x 


is 


u = [x — g(u)t] 
= x — g(u)t 
= x — ut 


In this particular example (although we can't do this in many examples), we 
can solve for u(x,t) explicitly in terms of x and t. Doing this, we get 


X 
dx) iran 


Check it. 
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PROBLEMS 


1. 


Solve the IVP 


PDE uU, + uu, = 0 —00 « x « c 0<t<om 
0 x<0 
IC u(x,0) = (a ie 


Draw the solution for different values of time. What is your interpretation 
of this solution? What is the relationship between the flux and density in 
this problem? 

Solve 


PDE u, + wu, = -o <x <% 0«t«o 


What is the flux-density relationship? Would you expect the solution to 
behave as it does? Compare the solutions of problem 1 and problem 2. 
Suppose a nonviscous liquid is traveling through a pipe and suppose the 
liquid leaks through the walls of the pipe according to the law F(u) — ku 
(g/cm sec). The conservation equation (nonconservation equation now) be- 
comes 


u, ffy = - F(u) 


What is the solution of this equation if f(u) = u and u(x,0) = o(x) (a general 
initial density)? What is the interpretation of your solution? 

What is the solution to this nonconservation equation if the loss to the 
outside is changed to F(x,t) = 1/x? Does your solution check? Does it make 
sense physically? 

Verify that u = [x — g(u)t] is an implicit solution of the nonlinear problem 


PDE u, + g(u)u, = 0 
IC u(x,0) = (x) 


OTHER READING 


1. 


An Introduction to Fluid Dynamics by G. K. Batchelor. Univesity Press, 1970. An 


excellent, comprehensive book on fluid dynamics. 
2. Formation and Decay of Shock Waves by P. Lax. Mathematical Monthly, March 
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1972. A readable account of how shock waves propagate in space, written by a leading 
mathematician. 


3. Introduction to Partial Differential Equations with Applications by E. C. Zachmanoglou and 
D. W. Thoe. Williams and Wilkins, 1976; Dover, 1986. Chapter 3 presents a nice description of 
first-order nonlinear equations with examples. 


4. Mathematical Theory of Traffic Control by F. A. Haight. Academic Press, 1963. A 
mathematical description of traffic control; one of the few books of this kind. 
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LESSON 29 


oystems of PDEs 


PURPOSE OF LESSON: To point out that many physical systems 
(particularly in fluid dynamics) cannot be described by a single PDE but, 
in fact, are modeled by a system of interlocking equations. In these equa- 
tions, several unknown functions like pressure — p(x,y,z,t), density — 
p(x, y, z,t) and temperature = T(x,y,z,t) (and their partial derivatives) are 
described by physical laws, and we seek to find all of these functions 
simultaneously. 
It will also be shown how the /inear system of equations 


u, + Au, = 0 


can be solved by decomposing it into a new system of independent equa- 
tions 


v, + Av, 


(This way, each equation can be solved separately.) 


In many areas of science, several unknown quantities (and their derivatives) are 
related by more than one equation. For example, in fluid dynamics, the four 
equations 


1 
u, + uu, + Vu, + p^* - 0 (Conservation of momentum 


in x-direction) 


(Conservation of momentum 


1 
v, + uv, + w, + -~p, = 0 
| p e 
in y-direction) 


(29.1) 
p, + (pu), + (pv), = 0 (Conservation of mass) 


( P ) 4 (2) + (£) ze (Conservation of energy) 
p" t p" x p" y 


Systems of PDEs 223 


where 


p(x,y,t) = Pressure of a fluid 
u(x,y,t) = x-velocity of a fluid 
v(x,y,t) ^ y-velocity of a fluid 
p(x,y,t) = Density of a fluid 


constitute a nonlinear system of PDEs known as Euler's equations of motion for 
a fluid. The problem we face here is to find the unknown functions p, u, v, and 
p simultaneously that satisfy the four equations (along with initial and boundary 
conditions). 

There are other reasons for studying systems of equations. If the reader recalls 
ODE theory, a second-order ordinary equation can be written as a system of 
two first-order equations. Although things are not quite so simple in PDE theory, 
it is often possible to write a single higher-order PDE as a system of first-order 
equations. For example, the telegraph equation 


oat: d 
u, = Cu, + au, + bu 


can be rewritten in equivalent form as three first-order PDEs by introducing the 
three variables u,, u, u, 


Uu, u 
uU, = W 
U3 = Uu, 


It is a simple matter to see that the telegraph equation is equivalent to the three 
equations 


TN 
ax : 
ðu 
29.2 — = u 
(29.2) "EE 
ou ou 
a = on + au, + bu, 


In order to solve systems like equations (29.2), it is necessary to be familiar with 
the eigenvalues and eigenvectors of a matrix. For that reason, we present a short 
review of linear algebra. 
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Linear Algebra Review 


General Case 


Definition: If A is an n by n matrix, 


then the n eigenvalues of A are the. 


n roots of the polynomial equation 
det (A — A) = 0 


where det (A — AJ) is the determi- 
nant of the matrix (A — AJ). Some ei- 
genvalues may be numerically the 
same. 


Definition: If X is an eigenvalue of the 
matrix A, then an eigenvector cor- 
responding to A is a nonzero vector 
satisfying Ax = Ax. 


Definition: The inverse of a matrix 
A is the matrix A^! that satisfies 
AA^! = A'A = I, where I is the 
identity matrix. 


Special Case 


Example: 


1 1 
uadit 


Then the two eigenvalues are the 
roots of the equation 


1-A 1 
zii 4 dum 
=(1 -— aA) - 4 
=X -20-3=0 
or\, = —land à, = 3. 


Example: X = H is an eigenvector 


corresponding to A, = 3, since 


TE 


Example: The inverse of 


Tik 


is 


since 
1 0 
-1 = -14 = 
AA A'A I 1 
Diagonalization of a Matrix 
If A is an n by n matrix with n distinct eigenvalues \,, M2, . . . À, and if 
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| T 
AE 
P=] X,|X,|...1X, |= 
M oo 
| | | 
Hp 3 


X, Xn X 


nn 


is the matrix whose n-th column is the eigenvector X, corresponding to À,, then 
PAP =A 


where P^! is the inverse of P, and A is the diagonal matrix 


ry 
No O 
A = 
O 
X, 
For example, the matrix 
_ {0 8 
has eigenvalues A, = 4 and M, = —4, with corresponding eigenvectors 


Hence, the following product: 
-1 
2. 5-2 0 8112 -2 
-1 — 
E AP - [i 1 L Jit | 
_ 114 12||0 811]2 -2 
—.|-14 12||2 O[|1 I 
is equal to the diagonal matrix 
.|4 0 
eat) 
(The reader can check this.) 
We will now solve a simple system of two equations (along with their ICs). 
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Solution of the Linear System u, + Au, = 0 


Consider the intitial-value problem consisting of two PDEs and two ICs 


PDE1 24 4 go _ 
ot Ox 
—o«x«o 0O<t<oa 
ð i 
PDE2 96,594. 
ot Ox 


(29.3) 
IC 1 u,(x,0) = f(x) 
—oo« x¥< Ow 
IC 2 u(x,0) = g(x) 


This problem might correspond to finding u,(x,f) = pressure and u,(x,t) = 
density as a function of (a space variable) x and (time) t when we are given the 


initial pressure and density. 


We start by writing the two PDEs in matrix form 


at |, 0 8 ax | _ | 0 
du, 2 0 ou, 0 
ot Ox 
or 
(29.4) u, + Au, = 0 
where 
_|9 8 _ | àt _ | ox _ 10 
a= |? E u, — ðu, u, = au, o= [o] 
ot Ox 


Now, we introduce a new unknown (change of variables technique) 


by means of the transformation: 
u = Pv 
where P is the matrix whose columns are the eigenvectors of A (we already 
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know P). It turns out that v will satisfy a very easy system of equations (the two 
equations in the new unknowns v, and v, are independent of each other), and, 
hence, we can find v, and v, easily. After we find v, and v;, we then compute 
u, and u, from 


u = Py 
First, however, let’s see what system of equations v satisfies. To see this, the 


reader must think in terms of matrix calculus; that is, if we start with the matrix 
transformation u = Pv, we can differentiate these equations to get 


(29.5) au av 
— = P 
ox ox 


(The reader should write these equations out in expanded form to make sure 
he or she knows what’s going on.) We now substitute equations (29.5) into our 
system 


u, + Au, = 0 
to get 
Pv, + APv, = 0 
and if we multiply each side of this vector equation by P~', we have 
v, + P-'APv, = 0 
or 
(29.6) v, + Av, = 0 
Since we have already seen that 


MUR 


for our matrix A, we can expand equation (29.6) to get the two equations 


cid ipae sg 

ot Ox 
(29.7) 

3v, 48¥2 _ 

ot ox 


228  Hyperbolic-Type Problems 


These are the two uncoupled equations that we can solve independently. In fact, 
the reader should know that these equations have travelling-wave solutions 


Vi(x,r) = d(x — 4t) 
v(x,t) = w(x + 4t) 


(where and y are arbitrary differentiable functions). 
These are the values of v, and v,. To obtain our general solution u, we merely 


compute 
= =the =? Vi 


_ E 7 b = "il 

1 1 W(x + 4t) 
7 Fes — 4t) — 2W(x + “| 
~ 1 d(x —4t) + y(x + 4t) 


In other words, 


(29.8) u(x,t) = 26(x — 4t) — 2y(x + 4I) 
u(x,t) = d(x — 4t) + W(x + 4t) 


Hence, we have found the general solution to the two PDEs of problem (29.3). 
A typical solution (there are an infinite number) would be to let 


= : (Two arbitrary functions) 


dx o 


and, hence 


u(x,t) = 2 sin (x — 4t) — 2(x + 41) 
u(x,t) = sin (x — 4t) + (x + 4ty 


We now substitute general solution (29.8) into the ICs 


u,(x,0) = f(x) 
u,(x,0) = g(x) 


to get 


26(x) — 2p(x) = f(x) 
(x) + W(x) = g(x) 
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Solving for ọ and v gives 


6Q) = 4 UG) + 200] 


VG) = F Re) - fto) 


and, hence, the solution to IVP (29.3) is 


u(x,t) = 26(x — 4t) — 2w(x + 4t) 


= = Uf — 4t) + 2g(x — 40] - = [2g + 4t) — f(x + 4t)] 


(29.9) 
u(x,t) = d(x — 4t) + bx + 4t) 


=H = 4) + 2g(x = 4) + F [ele 4) — flx + 40) 


NOTES 


1. Many numerical methods have been developed to solve systems of equations, 
and, hence, computer programs are often written to solve a system of n 
first-order equations. For that reason, when using these programs, it will 
often be necessary to write your higher order equation as a system. 

2. The linear system 


u, + A(x,t)u, = 0 
can also be solved similarly to the way we solved u, + Au, = 0. The major 


difference is that now the matrix P of eigenvectors A(x,t) may be functions 
of x and t. 


PROBLEMS 


1. Write the system of PDEs in equations (29.2) in matrix form 
Au, + Bu, + Cu = 0 


where A, B, and C are three by three matrices. 
2. Find the eigenvalues and eigenvectors of the matrix 


epi 
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3. Using the results of problem 2, what is the general solution of the system 


ot Ox Ox 
ðu, | (Qs Oy _ 


+4 
at ax ax 


HINT First rewrite the system in matrix form u, + Au, = 0. 
Verify equations (29.5) by writing them in scalar form. 


Verify that functions u, and u, in equation (29.8) satisfy the two PDEs in 
equation (29.3). 


p em 


OTHER READING 


Introduction to Partial Differential Equations with Applications by E. C. Zachmanoglou and D. W. 
Thoe. Williams and Wilkins, 1976; Dover, 1986. A well-written text containing an excellent 
treatment of systems; more advanced than this text. 
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LESSON 30 


The Vibrating Drumhead (Wave 
Equation in Polar Coordinates) 


PURPOSE OF LESSON: To show how the wave equation can describe 


the vibrations of a drumhead. The basic equation here is the wave equation 


1 1 
U, = C? (u + -u, + iue) 
r r 


which, if we look for fundamental standing-wave solutions 
u(r,0,t) = R(r)O(0)T(¢) 
is reduced to three ordinary differential equations 


T" + X)cCT20 (Simple harmonic motion) 
DR" + rR' + (Nr! —^nm)R = 0 (Bessel’s equation) 
6" + "0-20 (Simple harmonic motion) 


All products R(r)O(0)T(t) of solutions to the three ordinary differential 
equations describe the basic vibrations of the drumhead, while R(r)O(9) 
describes the shape of the vibrations. To find the vibrations of the drum- 
head that satisfy arbitrary initial conditions, we add the basic fundamental 
vibrations in such a way that the initial conditions are satisfied. 


The purpose of this lesson is straightforward: to find the vibrations of a circular 
drumhead with given boundary and initial conditions. For simplicity, we let the 
radius of the circle be one and the boundary data be zero. Hence, the problem 
is to find u(r,0,t) (which stands for the height of the drumhead from the plane) 
that satisfies 


1 1 
PDE Un = c (u, + P + m 0O<r<l 


BC u= 0 whenr = 1 0<t< 


232  Hyperbolic-Type Problems 


u = f(r,0) = 
ICs = n when: = 0 


See Figure 30.1. 


u=0 
FIGURE 301 Vibrating drumhead (hyperbolic IBVP). 


To solve this problem, we recall the violin-string problem from Lesson 20 
whose solution involved the superposition of an infinite number of simple vi- 
brations. If we approach the drumhead in a similar manner, we will look for 
solutions of the form 


uļlr,0,t) = U(r,6)T(t) 


This gives the shape U(r,0) of the vibrations times the oscillatory factor T(t). 
Carrying out this substitution (problem 1 in the problem set), we arrive at the 
two equations 

V?U + XU = 0 (Helmholtz equation) 

T' + XET = 0 (Simple harmonic motion) 


where 


1 
V2U = U, + zU. + A 


Note that we have required the separation constant to be negative (hence, we call it À?), 
since we want T(t) to be periodic. 

For our next step, we want to solve the Helmholtz equation, but, first, it 
needs a boundary condition. To find it, we substitute u(r,0,t) = U(r,0)T(t) into 
the boundary condition of the drumhead to get 


u(1,6,4) = U(1,09)I() 0 0<t<% 
Or 
U(1,9) = 0 


Hence, we now have the following problem to solve in order to find the shapes 
U(r,0) of the fundamental vibrations: 
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VU + XU-0 
U(1,8) = 0 


This is an elliptic eigenvalue problem (very famous), and our purpose is to seek 
all A's (if any) that yield nonzero solutions. The solutions U(r,0) stand for the 
shapes of the fundamental modes of vibration of the drumhead, while the A's 
turn out to be the roots of certain Bessel functions and are proportional to the 
frequencies of these vibrations. 

So, the next step is to solve the Helmholtz eigenvalue problem (this is an 
important problem in itself). We solve it like most other linear, homogeneous 
PDEs with zero boundary conditions (by separation of variables). 


Solution of the Helmholtz Eigenvalue Problem 
(Subproblem) 


To solve 


PDE V2U+U =0 
BC U(1,0) = 0 


we let 
U(r,9) = R(r)O(0) 
and plug it into the Helmholtz BVP. Doing this, we arrive at 
rR" + rR’ + (Nr?! nm)R = 0 (Bessel’s equation) 


R(1) = 0 
o" + nO = 0 


(Do this yourself). Note that we have chosen the new separation constant n’, 
n = 0,1, 2, ... (we get a new separation constant every time we separate 
variables), because we want O(0) to be periodic with period 27 (it’s obvious we 
want the membrane (drumhead) to be periodic in 0). So, in order to solve the 
Helmholtz equation, we must solve the two ordinary differential equations 


rR" + rR’ + (r£, — n’)R = 0 O<r<l 
R(0) < œ (Physical condition) 

R(1)=0 

OQ" + 70-20 


Bessel's Equation 
The equation 
rR" + rR’ + Q’r — n’?)R = 0 
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is well-known in ODE theory; it is called Bessel's equation and has two linearly 
independent solutions. They are 


R,(r) = AJ,(Ar) n-th-order Bessel function of the first kind 
R,(r) = BY,(Ar) n-th-order Bessel function of the second kind 


and, hence, the general solution (all solutions) to this equation is 
R(r) = AJ,(Nr) + BY,(Ar) 
Note that the solutions depend on the n and ^ in the equation. The graphs of 


these functions are well-known and can be found in reference 2 of Other Reading. 
Also see Figure 30.2. 


Bessel 
functions of the first kind 


/ Bessel 
functions of the second kind 


FIGURE 30.2 Bessel functions. 


In order to find the functions J,(Ar) and Y,(Ar), we must resort to the method 
of Frobenius, which is to find solutions R(r) as power series. It turns out that 
we can find two linearly independent power series J,(Ar) and Y,(Ar). Since the 
functions Y,(Ar) are unbounded at r = 0, we choose as our solution 
R(r) = AJ,(Ar) 
The last step in finding R(r) is to use the boundary condition R(1) = 0 to 
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find à (we're not interested in finding the coefficient A at this time). Substituting 
R(1) = 0 into R(r) = AJ,(Ar), we have 


T(r) 20 


In other words, in order for R(r) to be zero on the boundary of the circle, we 
must pick the separation constant à to be one of the roots of J,(r) = 0; that is, 


A = kin 
where K„m is the m-th root of J,(r) = 0. Tables of these roots are well-known, 
and computer programs are available to find them. A few of these roots are 


listed in Table 30.1. 


TABLE 301 The m-th Root of JÒ = 0 


3 
ARUN 


With these roots, we have just solved the Helmholtz eigenvalue problem. The 
eigenvalues à are &,,,; and the corresponding eigenfunctions U,,,(7,8) are 


U,(r,9) = J,(k,,r)[A sin (n9) + B cos (n0)] 


n=0,1,2,... m = 1,2,3,... 
We plot these functions for the different values of n and m in Figure 30.3. The 


general shape of U,,,(r, 8) is the same for different values of the constants A and 
B. Only the height of the vibration and placement of 0 = 0 is affected. 


Each U,,,(r,0) represents a fundamental vibration of the circular membrane with 
frequency 


fu, = kc2T cycles/unit time 
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FIGURE 30.3 Fundamental vibrations of a circular drumhead showing nodal 
lines. 


We find these frequencies by solving the time equation 


T" + kh. )T = 0 


to get 
T, (t) = A sin (k,, ct) + B cos (k,,ct) 
This solution is a simple oscillatory vibration with frequency 


fam = kC27 cycles/unit time 


It is interesting to note that the ratio of the frequencies of U,,,,(7,6) to the 
fundamental vibration U,,(r,0) is 
Sm _ Kam 


f 01 ko, 


which is not an integer as it was in the one-dimensional wave equation. In other 
words, higher vibrations for the drumhead are not pure overtones of the basic 
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frequencies. Note, too, that the nodal circles (where no vibration takes place) 
have radii' 


Now that we have solved the Helmholtz equation for the basic shapes 
U_,,.(r,8), the final step is to multiply by the time factor 


T, (t) = A sin (k,,,ct) + B cos (k, ct) 


and add the products in such a way that the initial conditions are satisfied. That 
is, the solution to our problem will be 


u(r, 0, t) = 2, 2, J (kun) Cos (n6)[A,,,,, sin (k,,,,ct) T Bin COS (k,,,,ct)] 


Note that A sin (n0) + B cos (n0) was replaced by cos (10) by proper choice 
of the angle 0. Also note that we have lumped together the constants as A,,, 
and B,,, (mere detail). 

Rather than going through the complicated process of finding A,,, and B,,, 
for the general case, we will find the solution for the situation where u is in- 
dependent of 0 (very common). In other words, we will assume that the initial 
position of the drumhead depends only on r. In particular, we consider 


u(r,0,0) = f(r) 
u(r,0,0) = 0 


(It’s just as easy to do the case where u, # 0.) With these assumptions, the 
solution now becomes 


(30.1) u(r,t) = 2, A, Jo(ko,r) cos (Ko,.ct) 


and our goal is to find A,, so that 
(30.2) f(r) = 2, Ado (Kom) 
m=1 


To find the constants A,,, we use the orthogonality condition of the Bessel functions (J, 


(kar): m = 1,2,...} 
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1 0 0$] 
[ 1D (kor) Jo(Kor) dr = 1 
"d i(Ko;) i=j 


(the evaluation of this integral can be found in books on Bessel functions). 
Hence, we multiply each.side of equation (30.2) by 7Ja(kąr) and integrate from 
0 to 1, giving 


A, Í rJi(kyr) dr = Í rf(r)J (Kor) dr 


from which we can solve for A, 


The solution to the vibrating membrane (indepent of 0) is equation (30.1), where 
the coefficients are given by equation (30.3). 
This solution is not'so complicated as the reader might think. We can interpret 
it as expanding the initial condition f(r) as the sum 
f(r) = AJK(kar) + Axo(Koar) + Aka) +... 
and then inserting the oscillation factor cos (k,,,ct) in each term; that is, 
u(r,t) = A,Jo(Kyir) cos (kgct) + Ax o(Kogr) cos (koct) +... 


For example, the solution to the vibrating membrane with initial conditions 


u(r,0,0) = J,(2.4r) + 0.5J,(8.65r) 
u(r,6,0) = 0 


would be 


u(r,t) = J,(2.4r) cos (2.4ct) + 0.5J,(8.65r) cos (8.65ct) 


Interpretation of J,(k,r), J(k,),... 
It would be helpful for the reader to know the interpretation of Jo(k;,7), Jo( ko), 
., inasmuch as the solution is the sum of these functions. We start by drawing 


A) (Figure 30.4) 


The Vibrating Drumhead (Wave Equation in Polar Coordinates 239 


FIGURE 30.4 . Zero-order Bessel function J (r). 


Now, in order to graph the functions Jo(ko,r), Jo(kor), . . . J(Komr) we rescale 
the r-axis so that the m-th root passes through r = 1 (Figure 30.5). 


(os 1) 


FIGURE 30.5 Graphs of J(k,,,/) (basic building blocks of the vibrating 
membrane). 


NOTES 


1. Suppose we initially displace the circular drumhead (with c= 1) with the 
ICs 


ic, — 14 (59,0) = Jo(2.4r) + 0.10J,(5.52r) 
u(r,6,0) = 0 (Initial velocity zero) 


See Figure 30.6. 


IC Decomposed into Basic Shapes 


FIGURE 30.6 ICs decomposed Into basic shapes. 
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In general, what we would do is expand the initial position f(r) into the sum of 
these basic shapes Jo(komr), observe the vibration for each one, and then add 
them up. The basic physical principle of the vibrating membrane is that each 
basic shape J,(2.4r), J,(5.52r), . . ., Jo(ko,r), . . . gives rise to its own simple 
harmonic motion (each point on the membrane vibrates with the same fre- 
quency). Here, since our IC is the sum of two basic shapes, the vibration of the 
membrane will be the sum of the two simple harmonic motions caused by the 
shapes; that is, 


u(r,t) = J,(2.4r) cos (2.4t) + 0.10J,4(5.52r) cos (5.521) 


Note that these two superimposed vibrations are complicated and that the higher 
frequency is not a multiple of the lower. 

2. For the vibrating membrane with initial conditions u = f(r), u, = 0, we can 
interpret the solution as expanding the initial condition f(r) as a sum of basic 
building blocks A, J;(k,,,r) and let each of them vibrate with its own frequency 
cos (k,,,ct), giving the fundamental vibration 


A,,J (Kor ) cos (k,,,,ct) 


We then add them up to get the vibration resulting from the initial condition 


f(r). 
PROBLEMS 


1. Substitute u(r,0,t) = U(r,0)T(t) into the wave equation 


1 1 
Ug = c? (u T T T dane 


in order to separate it into the two equations 


V?U + XU 
T" + XET 


0 
0 


2. Substitute U(r,0) = R(r)O(0) into the Helmholtz BVP 


V?U + U- 0 
U(1,6) = 0 
to get 
PR" + rR’ + (Nr! — n’?)R = 0 
R(1) = 0 
oe" + "0-0 


The Vibrating Drumhead (Wave Equation in Polar Coordinates 241 


Why do we choose the separation constant to be 0, 1, 2, . . . (which we 
decide to call n?)? 


3. Solve 
PDE u, = V?u O<r<l 
BC u(1,0,t) = 0 0<t<om 
u(r,6,0) —-1- r 
m irt. = 0 udo 
4. Solve 


PDE u, = V?u O<r<l 
BC u(1,0,7) = 0 0O<t<« 


u(r,0,0) = J,(2.4r) 
ICs ME -0 0zxrzxl 


5. Solve problem 4 but with the initial position of the membrane replaced by 
u(r,0,0) = J,(2.4r) — 0.5J,(8.65r) + 0.25J,(14.93r). What is the highest 
frequency in the vibration? 

6. Graph the following functions for 0 <r x 1: 

(a) J,(5.52r) 
(b) J4(14.93r) 


OTHER READING 


1. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Macmillan, 
1963; Dover, 1990. A comprehensive text with many examples; very good for engineers and 
physicists. The book solves the problem of the square drumhead; see Chapter 5.3 in particular. 


2. Tables of Functions with Formulae and Curves by E. Jahnke and F. Emde. Stechert, 1941; 
Dover, 1945. One of the best known books of tables; roots of Bessel functions are tabulated here. 
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PART 4 


Elliptic- Type 
Problems 


LESSON Of 


The Laplacian (an Intuitive 
Description) 


PURPOSE OF LESSON: To present an intuitive description of the 
Laplacian and show what it looks like in various coordinate systems. The 
most common coordinate systems in two and three dimensions are: 


V?u = U, + uy, Cartesian 

1 (Two dimensions) 

V?y = = x Polar 
r r 


V?u U, Cartesian 
(Three dimensions) 
EL + u, Cylindrical 


dex —A t —— Spherical 


Since the problem of transforming coordinates causes some students a great 
deal of difficulty, we will also discuss the chain rule that is used in making 
these transformations. 


The Laplacian operator 


2 2 2 
(31.1) VETE AMEN ODER 
ôx? oy! az 
is probably the most important operator in mathematical physics. The question 
is, what does it mean and why should the sum of three second derivatives have 
anything to do with the laws of nature? The answer to this lies in the fact that 
the Laplacian of a function allows us to compare the function at a point with 
the function at neighboring points. It does what the second derivative did in one 
dimension and might be thought of as a second derivative generalized to higher 
dimensions. We now give the basic interpretation of the Laplacian that makes 
it so useful. 
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interpretations of V2 in Two Dimensions 


If 
1. V?u > 0 at a point (x,y), then u(x,y) is smaller than the average of u at 
its neighbors [Say on a circle around (x, y)] 
2. V?u = Oat (x,y), then u(x,y) is equal to the average of u at its neighbors 
3. V?u « 0 at (x,y), then u(x,y) is greater then the average of u at its 
neighbors 


Using these principles, we can now interpret some of the basic PDEs of 
physics. 


Intuitive Meanings of Some Basic Laws of Physics 


The heat equation u, = o? V?u measures temperature (or concentration) u, and 
the equation can be interpreted to mean that the change in temperature (or 
concentration) u, (with respect to time) is proportional to V?u. That is, the 
temperature at a point is increasing if the temperature at that point is /ess than 
the average of the temperatures on a circle around the point. 


The wave equation u, = o?V?u measures the displacement (among other things) 
of a drumhead and can be interpreted to mean that the acceleration (or force) 
u, Of a point on the drumhead is proportional to V?u. That is, the drumhead 
at a point is accelerating upward (force is up) if the drumhead at that point is 
less (in height) than the average of its neighbors. 


Laplace's equation V?u = Q says that the solution u is always equal to the average 
of its neighbors. For example, a steady-state, stretched rubber membrane (not 
moving) satisfies Laplace's equation, hence, the height of the membrane at any 
point is equal to the average height of the membrane on a circle around the 
point. Figure 31.1 illustrates the meaning of the Laplacian. 


e 9 


V^u(p) =O V?^ulp) > 0 
Average value of z on a small circle Average value of u on a small circle 
around p is equal to u (p) around p is greater than u (p) 


e 


Average value of z on a small circle 
around p is smaller than u (p) 


V?u (p) <0 


(p is a point in two or three dimensions) 


FIGURE 311 Intuitive meaning of V?u. 


246  Elliptic-Type Problems 


Poisson's equation V?u = f, where f is a function that depends only on the space 
variables (can be a constant; can describe a number of phenomena). 

1. V?^u = —pdescribes the potential of an electrostatic field where p represents 
a constant charge density. What would be the nature of the potential field now 
that you know the meaning of the Laplacian? 

2. V?u = — g(x,y) describes the steady state temperature u(x, y) due to a heat 
source g(x,y). If g(x,y) is positive at a point, then heat is generated at that point. 
Negative g(x,y) means that heat is absorbed. 

3. V?u + Xu = Q is known as the Helmholtz equation (or the reduced-wave 
equation), which describes (among other things) the fundamental shapes of a 
stretched membrane. It's the equation we get when the time factor is separated 
from the wave equation or heat equation. 

So far, we've talked about the intuitive meaning of the Laplacian 


V?u 
V?u 


Wu + Uyy (Two dimensions) 
sub d uz (Three dimensions) 


However, in many problems, it is necessary to write this equation in other 
coordinates. For example, if the boundary of the region is a circle, then we must 
use polar coordinates (r,®), while if we are in three dimensions and our boundary 
is a sphere, then we turn to spherical coordinates (r,0,0). So the question be- 
comes, how do we rewrite the Laplacian in different coordinate systems? 

Before we start, however, let's review briefly the five major coordinate sys- 
tems in two and three dimensions; they are 


Cartesian system in two dimensions 
Cartesian system in three dimensions 
Polar coordinates (two dimensions) 
Cylindrical coordinates (three dimensions) 
Spherical coordinates (three dimensions) 


Polar coordinates are defined by 


r= x+y? 


0 = tan^! (y/x) 
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Cylindrical coordinates are defined by 


rP=x + y 
0 = tan^! (y/x) Or 
zz 


x 


Spherical coordinates are defined by 
r= x? + y*? + 2? 


cos o = 2/r 
tan 0 = y/x 


Changing Coordinates 


= r sin d cos 0 


r sin > sin 6 
r cos o 


We are now ready to change coordinates. As an illustration, we see how the 
two-dimensional Laplacian is transformed into polar coordinates. If we under- 
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stand this, then we should be able to change from any coordinate system to 
another. So, we begin with 
V?u = Uy + uy 


To find the new Laplacian, we begin by drawing the diagram shown in 
Figure 31.2. 


fx Oy 


x y 
FIGURE 34.2 Functional dependence of u on (70) and (x,y). 


The purpose here is to illustrate exactly what depends on what. For example, 
the diagram in Figure 31.2 illustrates that the variable u depends on the two 
new variables r and 0 and each, in turn, depends on x and y (lines illustrate 
dependence). We could also have drawn the diagram with r and 0 at the bottom, 
but since we want to derive expressions for u,, and u,,, this diagram is the most 
appropriate. So, how do we find u,, and u,, in terms of r and 0? 

It's really very easy; we first compute u, and u,. We find u, by adding up the 
paths in our diagram from u to x. In this case, there are two paths, so our 
answer is 


U, = uy. + uS, 
u, (cos 0) — u,(sin 0/r) 


The chain rule tells us to multiply the links of the paths together and add 
them up. 
By a similar argument, we have 


U, = usr, + U9, 
u, (sin 0) + u,(cos 0/r) 


Now for the second-order derivatives. We'll find u,, first (u,, will be 
an exercise for the reader). First, however, let’s draw another diagram 
(Figure 31.3). 
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Ux 


x y 
FIGURE 31.3 Functional dependence of u, on (7,6) and (x,y). 


The reader should realize at this point that if u depends on r and 0 (which, in 
turn, depends on x and y), then u, will also depend (in general) on the same 
variables. So, with that, we have 


Ux = (u) 
= (ur, + (u,),9, 
= (u, cos 0 — u, sin 0/r), cos 0 + (u, cos 0 — u, sin 0/r),(sin 0/r) 
= (u, cos 0 — u, sin 0/r + u sin 0/r?) cos 0 
+ (uj, cos 0 — u, sin 0 — Ug, sin 0/r — u, cos 0/r)( —sin 9/r) 


By a similar argument, we get 


= (u, sin 0 + u, cos 0/r — cos 0/r?) sin 0 + 
(u,, sin 0 + u, cos 0 + us, cos O0/r — u, sin 9/r) (cos 0/r). 


Uyy 


we get the desired result 


Adding u,, and u 


yy? 


This is the Laplacian in polar coordinates. It has the same intuitive meaning as 
the Laplacian in cartesian coordinates, but a different form. Unfortunately, it 
has variable coefficients, so equations involving the polar Laplacian are more 
difficult to solve. 

Carrying out a similar analysis for the three-dimensional Laplacian 


2 re 
V^u = U + uy, t U, 
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Changing to cylindrical coordinates, we can show 


NOTES 


1. 


The Laplacian in cartesian coordinates is the only one with constant coef- 
ficients. This is one reason why problems in other coordinate systems are 
harder to solve. It is still possible to use the separation of variables method 
for these equations with variable coefficients; it’s just that some of the 
resulting ordinary differential equations have variables coefficients. We ar- 
rive at a lot of fairly complicated equations, such as Bessel's equation, 
Legendre's equation, and other so-called classical equations of physics. To 
solve these equations, we must resort to infinite-series solutions and, in 
particular, the method of Frobenious. 

There are many more coordinate systems than the ones we've mentioned. 
For example, the vibration of an elliptical drumhead would require writing 
the Laplacian in an elliptical coordinate system. Rather than do this, how- 
ever, there is another approach: transform the ellipse into a region more 
to our liking (like a circle). We then solve the transformed problem into 
our new coordinates (polar coordinates) and then transform into the original 
coordinates. 


PROBLEMS 


What is the wave equation u, = a*V?u in spherical coordinates if you know 
the solution u depends only on r and f? 

What is the wave equation u, = o?V?u in polar coordinates if the solution 
u depends only on r and f? 

What is Laplace's equation V?u = 0 in polar coordinates if u depends only 
on 7? What are the solutions of this equation? These are the circularly 
symmetric potentials in two dimensions. 

What is Laplace's equation in spherical coordinates if the solution u depends 
only on 7? Can you find the solutions of this equation? These are the spher- 
ically symmetric potentials in three dimensions. 
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5. What can you say about the surface u(x,y) = xy? 
6. Transform the three-dimensional Laplacian V?u = u,,  u,, + U, to spher- 
ical coordinates. 


OTHER READING 


Fourier Series and Orthogonal Functions by H. F. Davis. Allyn and Bacon, 1963; Dover, 1989. An 


excellent text, written from an intuitive viewpoint; gives the reader the between-the-lines descrip- 
tion of many concepts. 
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LESSON 32 


General Nature of Boundary- 
Value Problems 


PURPOSE OF LESSON: To explain how PDEs that don't involve the 
time derivative occur in nature. These differential equations have no initial 
conditions like the hyperbolic-wave equation and the parabolic-heat equa- 
tion, but only boundary conditions. For that reason, these problems are 
called boundary-value problems (BVPs). 


The three most common types of boundary conditions (BCs) are: 
1. BCs of the first kind (Dirichlet BCs) 
2. BCs of the second kind (Neumann BCs) 
3. BCs of the third kind (Robin BCs) 
These are explained and examples are shown to illustrate these ideas. 


Until now, the problems we've discussed involved phenomena that changed over 
space and time. There are, however, many important problems whose outcomes 
do not change with time, but only with respect to space. These problems, for 
the most part, are described by elliptic boundary-value problems, and it is the 
purpose of this lesson to describe these types of problems. 

There are two common situations in physical problems that give rise to PDEs 
that don't involve time; they are: 

1. Steady-state problems 

2. Problems where we factor out the time component in the solution 
First, let’s look at steady-state problems. 


Steady-State Problems 


Suppose we look for the steady-state solution (solution when t — œ) of the heat 
equation 


u, = a? V?u 
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It's obvious if the solution doesn't change in time, then u, = 0, and so the heat 
equation is reduced to Laplace's equation 


V2u = 0 
To illustrate the concept of the steady state in detail, let’s consider the problem 


PDE uU, = Uœ + sin (mx) 0«x«1 0ct«« 


u(0,t) = 0 


HL en crc 


(32.1) BCs | 
IC u(x,0) = sin (31x) 0xxxl 


To find the steady-state solution u(x,) (if it exists), we let u, = 0 and solve the 
boundary-value problem 


d T 0c«x«l 
dà sin (Tx) X 
u(0) = 0 

u(1) = 0 


In this case, we have the solution 
1. 
u(x, œ) = a sin (mx) 


If we solved problem (32.1), we would get a solution that was initially sin (3x) 
but gradually looked more and more like 


1 
m sin (mx) 


For some problems, a zero steady-state solution may not exist, and for others, 
the steady state may be a sinusoidal function and, hence, it is not always valid 
to set U, Uw, .. . equal to zero. We should really know something about the 
physics of the problem. 
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Factoring out the Time Component in Hyperbolic and 
Parabolic Problems 


In the circular drumhead problem 


PDE u, = V?u 0zxrc«1l 
BC u= 0 On the circle 


u(r,0,0) = f(r,0) 
"us Ber -g(r,0) 


we looked for solutions of the form u(r,9,t) = U(r,0)T(t), which yielded the 
Helmholtz boundary-value problem 


PDE V2U + 2U =0 
BC _—-U(1,8) = 0 


This situation is common in PDEs where the solution represents a shape factor 
U(r,6) multiplied by a time factor T(. As a matter of fact, we arrive at this 
same Helmholtz equation by factoring out the time component in the heat 
equation 


u, = V?u 


When studying boundary-value problems (BVPs), there are three types of 
BCs that are most common; we discuss these three types now. 


The Three Main Types of BCs in Boundary-Value 
Problems 


Boundary-Value Problems of the First Kind (Dirichlet Problems) 


Here, the PDE holds over a given region of space, and the solution is specified 
on the boundary of the region. An example would be to find the steady-state 
temperature inside a region when the temperature is given on the boundary. 
Another situation would be to find the potential inside the region when the 
potential is given on the boundary; other examples follow. 


Examples of Dirichlet Problems 
Consider Laplace’s equation inside a circle with the solution given on the 
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boundary 
1 
BC u(1,8) = sin 0 0x60 «2m 


Yj 


u = sin Ó on the boundary 


FIGURE 32.4 Interior Dirichlet problem. 


PDE u,, + tu, + 


See Figure 32.1 


S 


Another example would be an exterior Dirichlet problem in which we are 
looking for the solution of Laplace's equation outside the unit circle, and the 
solution is given on the circle (Figure 32.2). 


4 


u = sin Ó on the circle 


A 
FIGURE 32.2 Exterior Dirichlet problem. 


Dirichlet problems are common in electrostatics when we want to find the 
potential in a region with the potential given on the boundary. 


Boundary-Value Problems of the Second Kind (Neumann 
Problems) 


Here, the PDE holds in some region of space, but now the outward normal 
derivative du/dn (which is proportional to the inward flux) is specified on the 
boundary. These problems are common in steady-state heat flow and electro- 
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statics, where the flux (in heat energy, electrons, and so forth) is given over the 
boundary. 
For example, suppose the inward flow of heat varies around the circle ac- 


cording to 
ou 
— = sin 0 
or 


The steady-state temperature inside the circle would then be given by the solution 
of the BVP 


Vu=0 OK<r<i 
BE amb r= 1 0<@0<2t 
or 
Here, we can see (Figure 32.3) that the flux of heat (cal/cm sec) across the 


boundary is inward for 0 < 0 < « and outward for «v < @ < 2m. 


Flow of energy 


(The temperature at each point is 
constant since the net flow in and out 
of that point is zero) 


FIGURE 32.3 Flow of heat for the Neumann problem. 


However, since the total flux 
27 2T 
f ao = | sin @ dð = 0 
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(a condition that must always be true for Neumann problems), we can say that 
the temperature at each point inside the circle does not change with respect 
to time. 

In other words, Neumann problems make sense only if the net gain in heat 
(or whatever) across the boundary is zero. Mathematically, this says that 


ðu 
con 


must be true around the boundary or else the problem has no solution. For 
example, the interior Neumann problem 


Vu = 0 0O<r<l 


~ (1,8) = 1 r=1 0x60-c«2m 


has no physical meaning, since the constant inward flux of one would not give 
rise to a steady-state solution. 

The Neumann problem is somewhat different from other boundary conditions 
in that solutions are not unique. In other words, the Neumann problem 


V7u = 0 0crc«1 


^ (1,0) = cos (20) r-1 0x0-«2m 


(note that the total flux across the boundary is zero) has an infinite number 
of solutions u(r,6). However, once we have one solution, we can get the 
others just by adding a constant. For example, one solution to our Neumann 
problem is 


u(r,9) = r^ cos (20) 


and it is obvious that if we add a constant to this solution, another one is 
obtained. For this reason, if we want to find one solution to the Neumann 
problem, we must have some additional information (like knowing the solution 
at one point). 


Boundary-Value Problems of the Third Kind 


These problems correspond to the PDEs being given in some region of space, 
but now the condition on the boundary is a mixture of the first two kinds 


ou 


+ hlu — g) = 
mm (u — g) = 0 
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where h is a constant (input to the problem) and g a given function that can 
vary over the boundary. A more suggestive form of this BC would be 


= — h(u - 8) 


which says the inward flux across the boundary is proportional to the difference 
between the temperature. u and some specified temperature g. This has the 
interpretation that 

1. If the temperature u (on the boundary) is greater than the boundary 

temperature, then the flow of heat is outward. 

2. If u is less than the boundary temperature g, then heat flows in. 
This, of course, is just Newton’s law of cooling, and so these types of BCs are 
very natural in steady-state heat flow. 


Example 
Suppose the temperature directly outside the unit circle is given by g(0) — sin 
0. In this case, the flow of heat across the boundary would be given by 


= — h(u — sin 0) r=1 0x0-c2m 


and, hence, to find the steady-state heat inside the circle, we would have to solve 
the BVP 


PDE V?u = 0 0crc«1 


(32.2) T 
BC = +h(u-sind)=0 0<0<2n 


The constant h is a physical parameter and measures the amount of flux across 
the boundary per degree difference between u and sin 0 (it's difficult to measure, 
since it depends on the interface across the boundary). If h is large, then heat 
flow is great per temperature difference, and so the solution looks very much 
like the solution of the Dirichlet problem with BC g = sin 0. On the other hand, 
if h = 0, then the BC is reduced to the insulated BC 


ðu 
— = 0 
or 


The reader can imagine how the solutions to problem (32.2) could change as 
h goes from 0 to ». When h = 0, the boundary is completely insulated, and, 
hence, the solution u(r, 6) is a constant (the solution is not unique here, and any 
constant will work). As h gets larger and larger, the solution looks more and 
more like the solution to the Dirichlet problem with BC u = sin 0. When h 
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> 0, but close to zero, the solution will be almost identically zero (which is the 
average of sin 0 on the boundary). 


PROBLEMS 


1. Based on intuition, can you find the solution to the Dirichlet problem 


PDE V?u = 0 0<r<1 
BC u(1,0) = sin 0 0<@<2n 


2. Does the following Neumann problem have a solution inside the circle: 


PDE V2u = 0 0O<r<]l 
BC DH — sin? 0 
or 


3. For different values of h, imagine the solution u(r,0) to 


PDE Vu = 0 0«rc«1 
ðu 


— + — i — 
BC E h (u — sin 6) = 0 
4. What BVP would you solve to find the steady-state solution of 
PDE Us = Uy, — Uu +u O<x<]1 O<t<« 
u(0,t) = 0 
BCs M Üct«e 


u(x,0) = sin (3mx) 
" rir = 0 e 


5. Now that you know the physical interpretation of the Laplacian, what is the 
general nature of solutions of the Helmholtz BVP 


PDE V?u = —AX?u 0<r<1 
BC u(1,6) = 0 0x0-«2mT 
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6. What is the physical interpretation of the following mixed BVP inside the 


square 
RDE A Gapel 
u,(x,0) — h[u(x.0) - 22 20 qc 
gc 4 M1) = 1 
u,(0,y) = 0 0cy«1 
u(1,y) = 0 í 


OTHER READING 


Partial Differential Equations of Mathematical Physics by Tyn Myint-U. Elsevier, 1973. 
Chapter 8 of this text contains an excellent problem set for boundary-value problems. 
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LESSON OO 


Interior Dirichlet Problem for a 
Circle 


PURPOSE OF LESSON: To show how to solve the interior Dirichlet 


problem for the circle 
1 1 
PDE uu + Uu, + Me = 0 O<r<] 
BC u(1,6) = g(0) 0zx0c2m 


by separation of variables. The solution can be interpreted as expanding the 
boundary function as 


g(8) = Y fa, cos (n0) + b, sin (9)] 


and then finding the solution to each of the problems 


V?u 


= 0 V?u 
u(1,9) — 


= 0 
sin (n9) u(1,0) = 


cos (n0) 
Since these two problems have solutions 
u(r,9) = r sin (n0) u(r,9) = r cos (n0) 


the solution to the interior Dirichlet problem is 


x 


u(r,9) = »,r"[a, cos (nd) + b, sin (n9)] 


n=l) 


After this series is obtained, some algebraic manipulations are performed 
to arrive at an alternative integral-form of the solution. This new form, the 
Poisson integral solution, brings out some interesting ideas. 


262 Elliptic-Type Problems 


This lesson presents a number of new ideas as we solve the Dirichlet problem 


] 
(33.1) PDE u,, + ue + He = 0 O<r<] 


BC u(1,0) = g(0) 0zx0-«2T 


The method of separation of variables will be the usual procedure, but after we 
find this series solution, we then manipulate it to get an alternative formulation 
(Poisson integral formula). 

Problem (33.1) is very important in physical applications. It can be interpreted 
as finding the electrostatic potential inside a circle when the potential is given 
on the boundary. Another interpretation is the soap film model. If we start with 
a circular wire hoop and distort it so that the distortion is measured by g(0) and 
dip it into a soap solution, a film of soap is formed within the wire. The height 
of the film is represented by the solution of problem (33.1), provided the dis- 
placement g(0) is small. 

The reader should be well aware of the separation-of-variables technique 
outlined in Figure 33.1 and should work out the details (problem 1). 

A few comments on the outline in Figure 33.1 


" V?u 2 0 
u(1,@) - g(0) 
u(r,0O) - R(r)O(8) 


0" +20 =0 


A20 
O (0) 7» c cos (A0) + d sin (AB) 


r?R" *rR' - MR «0 
(Euler's equation) 
A=0 A>0 
R(r) =a'+ b In (r) R (r) a? + br? 


À 


Rí(rsar? — Throw out r^ 
A20 and /n (r) 


O (8) = c, cos (n0) + dp sin (n6) 
A=0,1,2,... (O is periodic) 


u, (r, 0) =r” (a, cos (n0) + b, sin (nO) ] 
all Solutions of the form R (r) © (0) 


oo 
r 


uir, 0) ” [a, cos (n0) + b, sin (n0)] 


n-0 


4, = 5; 6" (6) do a, =~ Sa" g (9) cos (n8) a0 


by == f" g(6) sin (n8) dO 


FIGURE 3311 Outline of the solution for the interior Dirichlet problem. 
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]. Thereader should verify that the separation constant must be nonnegative 
(that's why it's called À?). If the separation constant were negative, the 
function O(0) would not be periodic, while, on the other hand, if it were 
zero, we would throw out the In r term in solution R(r) = a + b In r. 

2. The reader should know how the constants a, and b, were obtained. 

To summarize, the solution to the interior Dirichlet problem (33.1) is 


(33.2) u(r,0) — y r"[a, cos (n0) + b, sin (n6)] 


Before we rewrite this solution in the alternative form, let's make some obser- 
vations. 


Observations on the Dirichlet Solution 


1. The interpretation of our solution (33.2) is that we should expand the 
boundary function g(0) as a Fourier series 


g(0) = $ [a, cos (n8) + b, sin (n6)] 


and then solve the problem for each sine and cosine in the series. Since 
each of these terms will give rise to solutions r” sin (10) and r” cos (n0), 
we can then say (by superposition) that 


u(r,9) = 2, r'[a, cos (n8) + b, sin (n9)] 


2. The solution of 
PDE V7u = 0 0crc«1 
BC u(1,9) = 1 + sin 0 + > sin (30) + cos (40) 
would be 


i 
u(r9) = 1 + rsin + 5 sin (30) + r*cos (40) 


Here, the g(@) is already in the form of a Fourier series, with 


a = 1 b =1 
a, = ] b, = 0.5 
All other a,'s = 0 All other b,'s = 0 
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and so we don’t have to use the formulas for a, and b,. 
3. If the radius of the circle were arbitrary (say R), then the solution 
would be 


x 


u(r,0) = 2, (r/R)'[a, cos (n0) + b, sin (n6)] 


4. Note that the constant term a, in solution (33.2) represents the average 
of g(0) 


1 2T 
ay = = | g(0) dO 


This completes our discussion of the separation-of-variables solution. We now 
get to the interesting Poisson integral formula. 


Poisson integral Formula 


We start with the separation of variables solution 


x 


u(r,0) = 2, (r'R)'[a, cos (n0) + b, sin (n9)] 


(we now take an arbitrary radius for the circle) and substitute the coefficients 
a, and b,. After a few manipulations involving algebra, calculus, and trigonom- 
etry, we have 


u(r,6) = = Í g(0) dð + - Ry | g(a) 
[cos (na) cos (n8) + sin (na) sin (n8)]doa 


= > | P 4 2 (rRy cos [n(0 — je da 


1 + Sry le^ 9 pep ome i} da 


—- P 


re? - a) re '?- a) 
T * IR — relay [R — re'e-9] * [R — ye 9^ zi (de 
aT (a) d 
2m ep Per io D 
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This last equation is what we were looking for; it's the Poisson Integral Formula. 
So what we have is an alternative form for the solution to the interior Dirichlet 


problem 
1 2T 
u(r,0) = an | | 


R? =- r? 


(33.3) EC EEG oae de 


Observations on the Poisson Integral Solution 


1. Wecan interpret the Poisson integral solution (33.3) as finding the po- 
tential u at (r,0) as a weighted average of the boundary potentials g(0) 
weighted by the Poisson kernel 


R2 = r2 
i k eee ee 
"Olsson Kerne! ="R? = ZrR cos (0 — a) 4 P 
This tells us something about physical systems; namely, that the potential 
at a point is the weighted average of neighboring potentials. The Poisson 
kernel tells just how much weight to assign each point (Figure 33.2). 


The square of this length is 
the denominator of the 
Poisson kernel 


g(a) 


FIGURE 33.2 u(r8) as a weighted sum of boundary potentials. 


For boundary values g(a) close to (r,0), the Poission kernel gets large, 
since the denominator of the Poisson kernel is the square of the distance 
from (r,0) to (R,a) (Figure 33.2). Due to this fact, the integral puts more 
weight on those values of g(a) that are closest to (7,6). Unfortunately, 
if (r,0) is extremely close to the boundary r = R, then the Poisson kernel 
gets very large for those values of a that are closest to (7,0). For this 
reason, when (7,8) is close to the boundary, the series solution works 
better for evaluating the numerical value of the solution. 
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2. If we evaluate the potential at the center of the circle by the Poisson 
integral, we find 


1 2T 
u(0,0) = 7— | g(a) da 


In other words, the potential at the center of the circle is the average of 
the boundary potentials. 

This completes our discussion. Offhand, the reader may think that this isn’t 

a very important problem, since the domain of the problem is so simple. It’s 
true that Laplace’s equation is easiest when the region in question is a circle, 
square, half plane, quarter plane, and so on, but there are a couple of important 
points to note. 

1. In many cases, the experimenter designs the physical apparatus and has 
the option of shaping the boundary any way he or she likes. 

2. Later on, we will study transformations known as conformal mappings, 
which allow us to transform complicated regions into simple ones (like 
circles). Hence, to solve the Dirichlet problem in an arbitrary region, all 
we have to do is transform it conformally into a circle, use the solutions 
we’ve found in this lesson, and transform back into the original coordi- 
nates. 


NOTES 


1. We can always solve the BVP (nonhomogeneous PDE) 


PDE V?u =f Inside D 
BC u=0 On the boundary of D 


by 
(a) Finding any solution V of V^V = f (A particular solution) 
(b) Solving the new BVP 


Vwy-0 Inside D 
W=V On the boundary of D 


(c) Observing that u = V — W is our desired solution 
In other words, we can transfer the nonhomogeneity from the PDE to the 
BC. 
2. We can solve the BVP (nonhomogeneous BC) 


PDE Vu = 0 Inside D 
BC u=f On the boundary of D 
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by 
(a) Finding any function V that satisfies the BC V = f on the boundary 
of D 
(b) Solving the new BVP 


VW = V?V Inside D 
W-0 On the boundary of D 


(c) Observing that u = V — Wis the solution to our problem 


In other words, we can transform the nonhomogeneity from the BC to the 
PDE. 


PROBLEMS 


1. Carry out the details for the separation-of-variables solution to the interior 
Dirichlet problem (33.1). It's very important to know the details, since when 
we solve other Dirichlet problems in the next lesson, there will be some very 
interesting differences. You should especially know why the separation con- 
stant à cannot be negative. Also when A = 0, an important solution is 
thrown out; what is it? Look at the outline in Figure 33.1. 

2. What is the solution to the interior Dirichlet problem 


1 1 
PDE u,, + u, + —ug = 0 O<r<l 
r y^ 


with the follwing BCs: 
1 
(a) u(1,9) = 1 + sin + 5 COS 0 
(b) 4(1,9) = 2 
(c) u(1,0) = sin 0 
(d) &(1,9) = sin 30 
What do the solutions look like? Do they satisfy Laplace's equation? 


3. What is the solution to the following interior Dirichlet problem with radius 
R = 2: 


PDE Vu =0 OK<r<2 
BC u(2,0) = sin 0 0<0<2n 
What does the graph look like? 


4. What would be the solution of problem 3 if the BCs were changed to u(2,6) 
= sin (20)? What does this graph look like? 
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5. Solve 


PDE V?u = 0 0<r<1 


sin 0 0x0-cm 
Ner nee t m «6 «2n 
Roughly, what does the solution look like? 
6. What does the Poisson kernel look like as a function of a: 0 S a < 2m for 
r = 3R/4, 0 = «/2? In other words, draw the graph of the Poisson kernel. 
7. Verify note 1 in the lesson. 
8. Verify note 2 in the lesson. 


OTHER READING 


Partial Differential Equations: An Introduction by E. C. Young. Allyn and Bacon, 1972. 
This text has a nice discussion on the Poisson integral formula. 
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LESSON 34 


[he Dirichlet Problem in an 
Annulus 


PURPOSE OF LESSON: To solve the Dirichlet problem between two 


circles (annulus): 
1 1 
PDE Hu, + RT + jio = 0 R,<r<R, 


R,,9) = g,(8) 
BC «(Ri 0822 
? — u(R,0) = g,(8) ü 


The technique used will be separation of variables, and it is similar to the 
interior Dirichlet problem except that now we don't throw out the solutions 


1. 1 
"E (n8) on COS (n0) In r 


as we did before. Hence, our solution will be 


u(r,9) = ay + bylnr + 


> [(a,r" + b,r-") cos (n0) + (c,r"  d,r-") sin (n0)] 
l 


n= 


We will also discuss briefly the solution to the exterior Dirichlet problem. 
In this case, we throw out those terms that are unbounded at r = œ, Hence, 
the exterior Dirichlet problem 


PDE V?u = 0 Lr 
BC u(1,9) = g,(0) 0x0 x2T 


has the solution 


u(r,9) = > r-"[a, cos (n0) + b, sin (n9)] 


n= 
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There are many regions of interest where we might solve the Dirichlet problem. 
Just to name a few, we could have the Dirichlet problem: 

(a) Inside a circle (Lesson 33) 

(b) In an annulus (this lesson) 

(c) Outside a circle (this lesson) 

(d) Inside a sphere (later) 

(e) Between two spheres (later) 

(f) Between two lines (in two dimensions) 

Between two planes (in three dimensions) 

The list is endless. Our intention is to solve a representative sample of Dirichlet 
problems, so that the reader learns the general principles and is able to solve 
new ones on his or her own. 

The goal in this lesson is to find the shape of a soap film between two warped 
hoops. Our intuition is probably not so good here as it was in the interior 
Dirichlet problem. The model for this problem is 


1 1 
PDE u,, + " t aoe = 0 R,<r<R, 


R,,9) = g,(0) 
BC u(R, 1 0<0<2 
: eon = g,(0) E 


(34.1) 


The general picture for this problem can be seen in Figure 34.1. 


FIGURE 341 Laplace's equation in an annulus. 


The problem here is to find the solution u(r,0) between the two circles r = 
R, and r = R,, which is given as g,(0) and g;(0) on the circles. We begin by 
looking for solutions of the form 


u(r,9) = R(r)O(0) 


The Dirichlet Problem in an Annulus 271 


Substituting this into Laplace’s equation, we get the two following ODEs in R(r) 
and O(0): 


PR" + rR' - WR -0  (Euler's equation) 
6" + 70 = 0 


Note that in the two equations, we required the separation constant to be greater 
than, or equal to, zero (we've called it \”), or else the solution for O(0) would 
not be periodic. The next step will be to solve these two ODEs and multiply 
their solutions together. This will give us our solutions to the PDEs that are of 
the form R(r)O(0). 

The more interesting of the two equations is Euler's equation. Fortunately, 
it is one of the few ODEs with variable coefficients that can be solved fairly 
easily. To find the solution, it is best to consider two cases. 


SOLUTION OF EULER’S EQUATION (P?R" + rR' — XR = 0) 


CASE1 (à = 0) Here Euler's equation reduces to 
rR" + rR' 20 
and it is easy to see that the general solution is 
R(r =a+blinr 
This can be found by letting V(r) = R'(r) and solving the new equation 
rV'(r) + Vir) = 0 


for V(r). After finding V(r) = c,/r (use the ODE technique of separation of 
variables), we substitute back to get 


R(r) = c, Inr + c; 
CASE 2 (A >0) Here Euler’s equation is 
PR" + rR' - NR =0 


and to solve this, we look for solutions of the form R(r) = r*. The goal is 
to find two values of a (say a, and o;) so that the general solution will be 


R(r) = ar™ + br 
Plugging R(r) = r* into Euler's equation yields a = X, —X and, hence, 


R(r) = ar^ + br^* 
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Using this solution to Euler's equation, we now have 


A20 R(r) =a+binr 
i O(0) = c + dð 


R(r) = ar^ + br-* 
Asa p = c cos (A0) + d sin (40) 


and using the requirement that O(0) must be periodic with period 277, we have 
that à must be 0,1, 2, .... Hence, we arrive at the following solutions to 
Laplace's equation: 


Product Solutions to Laplace’s Equation 


c (constants) 

c In r 

cr" cos (n0) 

cr" sin (n0) 

cr^" cos (n0) 

cr^" sin (n0) 
Since any sum of these solutions is also a solution, we arrive at our general 
solution 


u(r,) = a, + byInr + > [(a,7 + br~”) cos (n0) 


(34.2) n=l 
+ (c,r" + d,r-") sin (n0)] 


to Laplace's equation. 
The only task left is to determine the constants in the sum (34.2) so that 
u(r,0) satisfies the BCs 


u(R,,6) = g,(8) 
u(R2,0) = g,(8) 


Substituting the above solution (34.2) into these BCs and integrating gives the following 
equations: 


2T 


1 
ay + byln R, OE gi (s) ds 


a + b, In R, = A 


2T 


2n (Solve for ao, bo) 
[ 82(s) ds 
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1 2T 
a,Ri + b,R”" = = gi(s) cos (ns) ds 
T 


(34.3) (Solve for a,,b,) 


1 2T 
a,R3 + b,R;" = i Í g,(s) cos (ns) ds 


1 2T 
c,R! + d,Rj" = Ji g(s) sin (ns) ds 


1 (7 (Solve for c,,d,,) 
c,R5 + d,R;" = " I g,(s) sin (ns) ds 


From these equations, we can solve for the constants aj, bo, a,, b,, Ca, and d,. 
We've now solved problem (34.1). The solution is (34.2), where the constants 
are determined by equations (34.3). 

We will work a few simple problems in order to give the reader a feeling for 
this solution. 


Worked Problems for the Dirichlet Problem in an 
Annulus 


Example 1 
Suppose the potential on the inside circle is zero, while the outside potential is 
sin 0 


PDE V?u = 0 l1<r<2 


u(1,6) = 0 
BCs Pr EN. 0zx602zx2m 


The first step in computing the solution is to compute the integrals in equations 
(34.3). Carrying out these simple calculations and solving the necessary equations 
for ae, bo, An, b,, Ch, and d, yields: 


a = 0 

by = 0 

a, = 0 - 

WS n = 1, 2, 
_ 42/3 n= 1 

e = V0 all other n’s 

g {728 n=l 

^ 10 all other n’s 
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These values give the solution as 


u(r,8) = 2(, ~ L) sin 0 


We can easily check that u(r,@) satisfies the two BCs. It's obvious that it satisfies 
Laplace's equation, since it is in the form of the general solution (34.2). 


Example 2 
Consider the problem with constant potentials on the boundaries 


PDE Vu = 0 ]«ra«2 


Gs pus 3 


0zx602z2T 


u(2,6) = 5 


In this case, we can save ourselves a lot of time, since it’s obvious that the 
solution is independent of 0 (since the BCs are independent of 6). In other 
words, we know our solution must be of the form a, + b, In r. Using our two 
equations for a, and by, we obtain 


| 
WW 


a + bln 1 = 
a + byln2 


I 
CA 


Or 
a = 3 b, = 2/In 2 = 2.9 
Hence, the solution is 
u(r,9) = 3+ 2.9Inr 


The graph of this solution is given in Figure 34.2. 


| 
| 
| 
| 
| 
| 
! 
| 
| 
| 
| 
| 
| 
| 
2 


r 


FIGURE 34.2 Radial slice of the potential inside the annulus (1 « r « 2). 
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Example 3 
Another interesting problem is 


PDE V?u = 1«r«2 
u(1,6) = sin 6 
SS Ma =sing 09*9*7m 


A quick check of the coefficients ao, bo, a,, b,, Cn, and d, reveals that they are 
all zero except for c, and d,. In fact, the equations for c, and d, are 


1 2T 
c, + d, -1f sin? s ds = 1 
ar Jo 
1 2T 
2c, + d/2 = RT sin? s ds = 1 
ar Jo 
Solving for c, and d, gives c, = 1/3 and d, = 2/3. Hence, the solution is 


u(r,6) = (y + 2) sin 0 


The shape of this curve for different values of 0 is shown in Figure 34.3. 


FIGURE 34.3 Soap film between u(1,9) = sin @ and u(2,0) = sin 0. 


We finish this lesson with a short discussion of the Dirichlet problem outside 
the circle. 
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Exterior Dirichlet Problem 


The exterior Dirichlet problem 


PDE SERT l<r<ea 
r r 
BC  .u(1,0) = g(0) 0<0<2n 


is solved exactly like the interior Dirichlet problem in Lesson 33 except that now 
we throw out the solutions that are unbounded as r goes to infinity. 


r” cos (n0) r" sin (n0) In r 


Hence, we are left with the solution 


(34.4) u(r,0) = Y", cos (n0) + b, sin (n0)] 


where a, and b, are exactly as before 


1 27 
ay = > | g(0) 46 


27 


1 2n 1 
inim f g(0) cos (n0) dð b, = E g(0) sin (n0) dé 


In other words, we merely expand u(1,9) = g(0) as a Fourier series 


g(8) = » [a, cos (n0) + b, sin (n6)] 


n=0 


and then insert the factor r^" in each term to get the solution. 
To gain a little familiarity with this solution, two examples are given. 


Examples of the Exterior Dirichlet Problem 


Example 1 
The Exterior Problem: 


PDE V?u = 0 1«r«o 
BC u(1,6) = 1 + sin 0 + cos (30) 0x60zx2m 
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has the solution 
1. 1, 
u(r,9) = 1 + , sin 0 + , sin (30) 


Example 2 
The Exterior Problem: 


PDE V?u = 0 l<r<ex 
BC u(r,9) = cos (40) 0x60zx2T 


has the solution 
1 
u(r,8) = 7a COS (46) 


The reader should envision what this solution looks like. 


NOTES 


1. The exterior Dirichlet problem for arbitrary radius R 


PDE V?u = 0 R<r<e2x 
BC u(R,0) = g(0) 0z0z2m 


has the solution 
u(r,9) = >, (r/R)-" [a, cos (n0) + b, sin (n9)] 
n=0 


2. The only solutions of the two-dimensional Laplace equation that depend 
only on r are constants and In r. The potential In r is very important and is 
called the logarithmic potential; it will be discussed in more detail later. 


PROBLEMS 


1. Solve the Dirichlet problem 


PDE V2u = 0 1<r<2 


u(1,0) = cos 0 
EIS ns — sin 0 


2. What is the solution to the exterior Dirichlet problem 
PDE V^? u = 0 l<r<a 
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for the following BCs: 
(a) u(1,0) = 1 
(b) (1,9) = 1 + cos (30) 
(c) (1,9) = sin (6) + cos (30) 
1 0x0c«m 
(d w180 7150 ce < 2m 
3. The exterior Neumann problem 


PDE Vu = 0 l<r<ax 
BCs ~ (1,8) = g(8) 0<@<2n 


has a solution that is the same form as the Dirichlet problem 


u(r,9) = p r "[a, cos (n9) + b, sin (10)] 


n=() 


but now the coefficients a, and b, must satisfy the new BC. Substitute this 
solution in the BC 


Ou 
— (1,0) = sin 0 
" (1,0) sin 


in order to obtain the solution to 
V?u = 0 l<r<o 
ðu 
— (1,0) = sin 0 
or (1,8) 
Does your solution check? Of course, once you have this solution, any 


constant plus this solution is also a solution. 
4. Substitute the general solution (34.2) into the BC 


u(R,,8) = g,(8) 
u(R,9) = g;(8) 


and integrate to get equations (34.3). 


OTHER READING 


Partial Differential Equations by Tyn Myint-U. Elsevier, 1973. An excellent discussion 
of the Dirichlet problem; many problems are worked out. 
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LESSON 35 


Laplace's Equation in Spherical 
Coordinates (Spherical Harmonics) 


PURPOSE OF LESSON: To find particular solutions of Laplace's 


equation in spherical coordinates, so that they can be fitted together in 
various ways to solve different problems (like Dirichlet, Neumann, for 
example). We will also solve the interior Dirichlet problem 


PDE (r-u,), + [sin 6 uale + sin’ g“ = 0 


1 
sin o 
BC u(1,0,5,) = g(o) 0zxóz 


for the special case where the boundary potential g(o) depends only on o 
(the angle from the north pole). Here, we expand the boundary potential 
g() as an infinite series of surface harmonics 


x 


g(6) = > a,P,(cos $) 


n=0 


where the surface harmonics P,(cos o) (called Legendre polynomials) are 
all particular solutions to Laplace’s equation and are polynomials in cos ó 
of degree n. After finding this expansion, the solution is just 


u(r.) = Y, a,"P, (cos 6) 


The analogous exterior Dirichlet problem has the solution 


x 


u(r.) = D 5 P,(cos à) 


An important problem in physics is to find the potential inside or outside a 
sphere when the potential is given on the boundary. For the interior problem, 
we must find the function u(r,0,o) that satisfies 
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E a 1 
PDE (r2u,), + ee (sin ro) uslo + e Uy, = 0 


(35.1) 
BC u(1,0,0) = g(0,0) -mn <@0<7 0<o<7 


Note that this spherical Laplacian is written in a different form than those we’ve 
seen before. This form is slightly more compact and easier to use. 


Vale , 


x 


FIGURE 35.4 Dirichlet problem interior to a sphere. 


A typical application of this model would be to find the temperature inside a 
sphere when the temperature is specified on the boundary. Quite often g(0,6) 
has a specific form, so that it isn't necessary to solve the problem in its most 
general form. 

Two important special cases are considered in this lesson. One is the case 
when g(0,6) is constant, and the other is when it depends only on the angle o 
(the angle from the north pole). 


Special Cases of the Dirichlet Problem 


special Case 1 g(0,6) = constant) 


In this case, it is clear that the solution is independent of 0 and 6, and so 
Laplace's equation reduces to the ODE 


(Pu), = 0 
This is a simple ODE that the reader can easily solve; the general solution is 
a 
(35.2) u(r) = " + b 
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In other words, constants and c/r are the only potentials that depend only on 
the radial distance from the origin. The potential 1/r is very important in physics 
and is called the Newtonian potential. We now work two problems where the 
petential depends only on r. 


Problem 1 (Potential inferior to a sphere) 


PDE Vu = 0 O<r<l 
BC u(1,9,0) = 3 


Here solution (35.2) must be u(r,8,d) = 3 in order to be bounded. 
Problem 2 (Potential between two spheres each at constant potential) 


Suppose we want to find the steady-state temperature between two spheres held 
at different temperatures. 


PDE Vu=0 R,<rK<R, 


u(R,,8,6) = A 
us Rege = Bb 


Since we know the potential has the general form 
a 
=- + 
u(r) i b 


we substitute it in the BCs and solve for a and b; doing this gives 


R,R, _ R,B = RA 


Qe RS R) ~ (R, — Ri) 


and, hence, 


(A — B)R,R, R,B-R,A 
= M gp 
(R, — Rr (R, — R,) 


FIGURE 35.2 Potential between two concentric soheres each at constant 
potential A and B. 
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The graph of this potential is given for different values of the boundary potentials 
A and B in Figure 35.2. 


special Case 2 [g(06,6) depends only on 9] 


Here, the Dirichlet problem takes the form 


1 
2 : 2 
PDE (ru), + ae [in du], =O O<r<t 
BC  4(19,0)- g( Ob 
Using separation of variables, we look for solutions of the form 
u(r.) = R(r)®(>) 


and arrive at the two ODEs 


PR": + 2rR' — n(n + 1)R = 0 (Euler’s equation) 
[sin p ®']' + n(n + 1) sind ® = 0 (Legendre’s equation) 


The separation constant is chosen to be n(n + 1) for convenience; the reader 
will see shortly why this choice is made. 

We now solve Euler's equation by substituting R(r) = 7° in the equation and 
solving for a. Doing this, we get two values 


a= íi 
—(n+1) 
and, hence, Euler’s equation has the general solution 
R(r) = ar" + br-**» 


Legendre’s equation isn’t so easy; the general strategy in solving this equation 
is to make the substitution 


x = cos o 


Making this change of variable gives rise to the new Legendre’s equation 


Q ~ a fS - ar + n(n 1) = 0 ~1l<x<1l 


The idea here is to solve for (x) and then substitute x = cos o in the solution. 
Legendre’s equation is a linear second-order ODE with variable coefficients. 
One of the difficulties in this equation is that the coefficient (1 — x?) of d?@/dx? 
is zero at the ends of the domain —1 < x « 1. Equations like this are called 


Laplace’s Equation In Spherical Coordinates (Spherical Harmonics) 283 


singular differential equations and are often solved by the method of Frobenius. 
Without going into the details of this method (see reference 1 of the recom- 
mended reading), we arrive at a very interesting conclusion. The only bounded 
solutions of Legendre's equation occur when n = 0,1,2,. . . and these solutions 
are polynomials P,(x) (Legendre polynomials) 


n=0 P(x) = 1 


n= 1 P(x) =x 


n=2 P(x) = = Ge — 1) 


1 
n-3 P(x) = 5 (5x - 3x) -1sx«xl 


] dq" 


n P (x) = TE 


[x? — 1) (Rodrigues' formula) 


The graphs of a few Legendre polynomials are shown in Figure 35.3. 


(-1, -1) 
FIGURE 35.3 Legendre polynomials P(x). 
We now have that the bounded solutions of 


PR" + 2rR' - n(n + 1)R = 0 0<r<1 
[sin 6 $']|' + n(n + 1) sind ® = 0 0<o<7 


are 


R(r) = ar^ 
(p) = aP,(cos >) 
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The function P,(cos o) is just the n-th order Legendre polynomial with x 
replaced by cos ó. The final step is to form the sum 


(35.3) u(r,o) = Y, a,7"P, (cos $) 


in such a way that it agrees with the BC u(1,6) = g(o). Substituting solution 
(35.3) into the BC gives 


$, a,P,(cos 6) = &(4) 


If we multiply each side of this equation by P,,(cos d) sin $ and integrate } 
from 0 to m, we get 


| g(o)P,,(cos p) sin > db Sa: f "Bios b) P, (cos $) sin $ dd 


Ya, [ Pop.) dx 


0 nm 


2m + 1 


We can verify that the Legendre polynomials are orthogonal on [— 1,1]. Hence 


2m + 1 


(35.4) men f 8(p) P,,(cos 6) sin 6 db 


and so the solution to our Dirichlet problem (35.1) is 


(35.5) | u(r) = 2, anr" P, (cos $) 


where the coefficients a, are given by solution (35.4). 
We now give an example of a cylindrically symmetric potential. 


Cylindrically Symmetric Potential (Independent of 8) 
Suppose the temperature on the surface of the sphere is given by 


g(6) = 1 — cos (26) Osbarr 
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and suppose we would like to find the temperature inside the sphere. In this 
problem, the temperature is constant on circles of constant latitude (for example, 
the equator has temperature 2). To find u, we must solve 


PDE V?u = 0 0<r<1 
BC u(1,8,ġ) = 1 — cos (26) 0zxdbzm 


See Figure 35.4 for a graph of the boundary temperature. 


g(à) 


1 - cos (20) 


ó 
0 71/2 T 


FIGURE 35.4 Temperature on latitude circles 6 radians from the north pole. 
Our goal now is to find the coefficients a, in solution (35.5); to find them, we 
can either 

(a) Use formula (35.4). 

(b) Use existing computer programs that find the coefficients in Legendre 

expansions (see your computer center). 

(c) Use a little common sense. 

Trying the latter, consider the trigonometric identity 


cos (26) = 2 cos? (6) - 1 


b 


which allows us to write the boundary temperature g(o) as 
1 — cos (26) = 1 — [2 cos? (6) - 1] 


: 
3 


1 - $[ cos? (4) - 1] + 


4 4 
3 P,(cos 6) — 3r 2 (cos >) 


This gives us the expansion of g(¢) as a series of Legendre polynomials; hence, 
the solution to the problem is 


4 
u(r,) = P,(cos 6) — 5-P.(cos ) 


4 2r 
-3- os $- 1) 
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The graphs of this solution are given in Figure 35.5 for various latitude values. 


+ 


4/3 


FIGURE 35.5 Temperature from the center of the sphere to the boundary. 


NOTES 


1. We can see that after expanding the boundary potential g(¢) as the series 
g() = > a,P,(cos ) 
we need only multiply the n-th term by r^ to get the solution 
u(r,d) = È a,r"P, (cos o) 


2. The solution of the exterior Dirichlet problem 


PDE Veu = 0 l<r<o 
BC _u(1,0,6) = g(o) 


x 


u(r.) = X = P,(cos 8) 


1—() 


where 


b, = a | g(ó) P, (cos à)sin ddd 


For example, the BC g(ó) = 3 would yield the solution u(r,$) = 3/r. Note 
that in this problem, the solution goes to zero, while in two dimensions, the 


exterior solution with constant BC was itself a constant. 
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PROBLEMS 


1. Substitute R(r) = r° into Euler's equation 
PR" + 2rR' — n(n + 1)R = 0 


to finda = n, — (n + 1) 


2. Make the change of variable x = cos ó to change the old Legendre’s equation 


in ^ 
[sin 6 $']' + n(n + 1)sinó* = 0 Osp 


to the new Legendre’s equation in x 


d?d do 
ims. e metet ens — + +10) 2-0 —] < < 
(1 x?) |y? 2x j n(n ) 1 X 1 


3. Verify Rodrigues’ formula 


1 d" ; R 
2”n! dx" [a=] 


P,(x) = 
for the Legendre polynomials P, P, P,, and P}. 


4. Solve the interior Dirichlet problem 


PDE V?u = 0 0<r<1 
BC u(1,0) = cos (36) 


Use a trig formula to try to write cos (36) in terms of cos ^, cos? 6, cos? 6,. . . and 
then combine them to get the expansion 


cos (36) = aP,(cos 6) + a,P, (cos) +... 


5. Solve 
V?u = 0 O<r<] 


_ jl 0 x $ x m/2 
(1,9) = » n2«óxm 


This is the problem where the boundary of the northern hemisphere is hot 
(+1), while the southern hemisphere is cold ( — 1). 
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6. What is the solution to the exterior Dirichlet problem 


PDE V2u = 0 1«r«o 
BC u(1,0) = 1 + cos o 


Does it check? 


OTHER READING 


Elementary Differential Equations and Boundary-Value Problems by W. Boyce and R. 
DiPrima. Wiley & Sons, 1969. One of the best ODE textbooks; Euler's, Bessel's, and 
Legendre's equations are discussed in this book. 
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LESSON 36 


A Nonhomogeneous Dirichlet 
Problem (Green's Function) 


PURPOSE OF LESSON: To show how a nonhomogeneous Dirichlet 


problem can be solved by the Green’s function approach (the impulse- 
response function). This important technique resolves the right-hand side 
of the equation (generally thought of as an input of some kind) into a 


continuum of impulses (delta functions or point inputs) at the different 
points of the domain. The response to each of these impulses is then found 
(Green’s function or the impulse-response function), and then they are 
summed (integrated) to give the overall response. 


A common problem in applied mathematics is to find the potential in some 
region of space in response to a forcing term f(x,y) acting inside the region. In 
electrostatics, the potential (volts) in a region D is sought in response to a charge 
density f(x,y) throughout that region. A typical example would be to find the 
potential inside a circle in two dimensions that satisfies (Poisson’s equation with 
zero BC) 


1 1 
(36.1) PDE u,, + yur + zie = f(r,0) 


BC (10-20 0<0<2n 


Note that we have chosen the boundary values to be zero. If we wanted to solve 
the general case, where both the equation and BC were nonhomogeneous, we 
could add the Poisson integral formula from Lesson 33 to the solution from this 
lesson. 

In order to gain a little intuition about nonhomogeneous differential equa- 
tions, let's consider graphing the solution to the following Poisson's equation: 


PDE V?u = -q 0«r«1 (q a positive constant) 
BC  Á (1090920 0sx0zx2« 


Here, the potential (temperature if you like) is fixed at zero on the boundary, 
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and the Laplacian of u is always equal to —4 inside the circle. Since V?u(p) 
measures the difference between u(p) and the average of its neighbors, Poisson's 
equation says that the surface u(r,6) will always be concave down, so to speak. 
In other words, it will look like a thin membrane fixed at the boundary that was 
continuously being pushed up by a stream of air from below. If the right-hand 
side were a function f(x, y) that changed over the domain, then the concavity at 
each point would change. 

We now get to the major part of this lesson: to introduce Green's function 
and solve equation (36.1). 

First, however, we must introduce the notion of potential due to point sources 
and sinks. 


Potentials from Point Sources and Sinks 


In solving a nonhomogeneous linear equation, it is sufficient to solve the equation 
with a point source, since we can find the solution to the general problem by 
summing the responses to point sources. Our goal here is to find the potential 
in some region of space due to a point source (or sink). We can interpret these 
points in a variety of ways. In heat flow, we could think of a source as a point 
where heat is created and a sink as a point where it is destroyed. On the other 
hand, in electrostatics, a point source would be a single positive charge (proton), 
while a sink would be a single negative charge (electron). In any case, whatever 
the interpretation, we will now find the potential u(r) in two dimensions that 
depends on a single point source (the potential in three dimensions is left as a 
problem). 

Suppose we have a single point source of magnitude +q located at the origin. 
It is clear that the heat (or whatever) will flow outward along radial lines, and, 
hence, if we compute the total outward flux across a circle of radius r, we have 
the situation described in figure 36.1 


2T 
"i u(r)r d 


Total outward flux across the circle 


—2nru,(r) 


Heat generated 
at the origin 


FIGURE 361 Radial flow of heat due to a point source. 
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But the outward flux must be equal to the heat generated within the circle 
(conservation of energy), and so we have 


—2nru,(r) = q 


Solving this simple differential equation for u(r), we get 


Work required 
to move a 
single charge 
from A to B 


—+— u(A) 


FIGURE 36.2 Potential due to a point source in two dimensions. 


In terms of electrostatics, the potential difference u(B) — u(A) represents the 

work needed to move a single positive charge from A to B (Figure 36.2). A 

sink, on the other hand, is represented by a negative source, and so a sink with 
magnitude —q would give rise to a potential field 

zr 

u(r) — LM 


This completes the discussion of potential due to point charges; we are now in 
position to solve the nonhomogeneous equation by means of Green's function. 


Poisson's Equation inside a Circle 


We will now solve the important problem 


1 1 
PDE u, + zur + fe = f(r,9) 0crc«1 
BC u(1,9) 0 0x0zx2m 


(36.2) 


The Green function technique (impulse-response method) consists of two steps: 
1. Finding the potential G(r,0,0,6) at (7,9), which we force to be zero on 
the boundary and which is due to a single charge (magnitude 1) at (p,6) 
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2. Summing the individual responses G(r,8,p,@) weighted by the right-hand 
side (charge density) f(r,0) over all (p,6) in the circle to get the solution 


u(r,8) = [ f G(r,0,0,6) f(p,^) p dp dd 


We now find the impulse response Gí(r,0,0,6) for our problem. 


Finding the Potential Response G(r,0,p,¢) 


We first replace the right-hand side f(r,6) by a point source of magnitude +1 
at an arbitrary point (p,d). Mathematically, we call a point source an impulse 
function (or delta function) and represent it by 8(r — p,0 — 4). We interpret 
this delta function as a function of r and 6 that is zero for all points except at 
(p,b), where the unit charge is located. In terms of forces, we could interpret 
the delta function as a point force of magnitude +1 at (p,b). The idea now is 
to find the potential response (which we force to be zero on the boundary) due 
to a single point charge. This function is called the impulse response function 
(or Green's function), and it is the response at (r,0) to a single source at (p,d). 
The difficulty in finding this function is due to the fact that it must vanish on 
the boundary. If we didn't require zero, then the problem would be easy, since 
we already know that 

1 1 
2m "n r 


is the potential due to a charge at (p,p) [where r is the distance from the charge 
(p.)]. 
Physically, finding G(r,8,p,@) corresponds to one of the following: 
1. Finding the equilibrium temperature inside the circle with a heat source 
at (p,o) and the boundary temperature fixed at zero. 
2. Finding the height of a stretched membrane fixed at zero on the boundary 
but pulled up to a great height at (p,¢). 
3. Finding the electrostatic potential inside the circle due to a single positive 
charge at (p,@) with the boundary potential grounded to zero. 
We will now find Green's function; it will look something like Figure 36.3. 


Unit circle 


FIGURE 36.3 Green's function G(r,9,p,9) due to a source at (pẹ). 
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Steps for Finding The Solution 


STEP! Since the function 


CET 
2T R 


is the potential at P = (r,6) due to a single unit charge at Q = (p,p) (where 
R is the distance from P to Q), the only thing left to do is modify the function 
so that it is zero on the boundary. 


STEP2 Physicists know from experiments that the potential field due to positive 
and negative charges placed a given distance apart give rise to circles of constant 
potential (Figure 36.4). 


Electron (Negative charge) 


e 
er charge 


Circles of constant negative potential 


Zero potential 


Circles of constant 
positive potential 


FIGURE 36.4 Potential field due to two oppositely charged particles. 


So the strategy in finding Green’s function is to place another charge (negative) 
outside the circle at such a point that the potential due to both is constant on 
the circle r = 1. We can then subtract this constant value to obtain a zero 
potential on the boundary. It is obvious now that this potential will satisfy our 
desired properties for G(r,8,p,). The big question is, of course, where do we 
place the negative charge outside the circle, so that the potential on the boundary 
is constant? Without going into the details, we can show rather easily that if the 


negative charge is placed at Q = (p,6) = (1/p,o), then the potential 


1 1 Em 
u(r,9) = n In 1/R — on In 1/R 


due to the two charges will be constant on the circle r = 1. The variables R and 
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R are the distances from the two charges to (7,9). In fact, the constant potential 
on the circle r = 1 can easily be shown to be 


-1 
— np (A positive constant) 


2T 
See Figure 36.5 
: (1/5,9)  O 
(Negative charge at Q) 
R 
at <_ | 


Constant potential on the circle r = 1 


FIGURE 36.5 Charges at Q and Q giving rise to constant potential at 
r= 1. 


With these steps in mind, we construct Green’s function 


(36.3) G(r,0,0,0) = = In 1/R — 2 In 1/R + E In p 
2m 2m 2T 
Potential due to Potential due to Subtracting the 
positive charge negative charge constant potential 
at Q at O on the boundary 


where 


R = Vr — 2rp cos (80 — p) + p 


R = bye = 25 cos (0 — ) + I/p’ 


(These two formulas are just trigonometric formulas for the distance between 
two points in polar coordinates.) To find the solution to our original problem, 
we merely superimpose the impulse functions; this brings us to the final step. 


STEP 3 Superposition of the impulse responses. This step is easy; we just write 


9) = |. [ GG.60.fo.)o do dà 


A Nonhomogeneous Dirichlet Problem (Green's Function) 295 


Or 


(36.4) 


1 2T pl m 
u(r,0) = — | | m (@RIR)f(0,0)p dp de 


This is Green's function solution of Poisson's equation inside a circle. If we were 
given the charge density f(r,0), we could evaluate this integral numerically. 


NOTES 


1. Itis also possible to solve 


PDE V?u = 0 0<r<1 
BC u(1,9) = g(0) 0<0<Ê2r 


by means of the Green’s function approach. In this case, the solution is 


2T 


«,9) = | St. 1,0) do 


0 


which, if we compute dG/dr (a rather tedious computation), gives 


j| pas 1-7 
Md adpebfic.der 
CA D 2m Jo f — 2r cos (0 — o) + = [eo ds 
which is the Poisson integral formula we found in Lesson 33. 


2. The solution to the general Dirichlet problem 


PDE V?u = f(r,0) O<r<l 
BC u(1,9) = g(8) 0 «60 x 2n 


would be the sum of equations (36.4) and (36.5). 


3. We can solve many problems in different domains by means of the Green 
function approach. However, we must find a new Green function for each 
domain and each new equation and finding Green's function is not always 
easy. 


4. To actually evaluate solution (36.4) for most sources f(r,9), we must resort 
to numerical integration on a computer. 
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PROBLEMS 


1. Find the potential due to a point source in three dimensions. 

2. Find Green's function G(x,y,é,n) for Laplace's equation in the upper-half 
plane y > 0. In other words, find the potential in the upper-half plane at 
the point (x,y) (zero on the boundary y = 0) due to a point charge at (£,). 
See the following figure. 


R= V(x - £)? + ly -7n)? 


R 


Q = (£n) 


R 


R= J (x -E + (y tn)? 


Q = (£, -n) 


HINT If we place a negative charge at Q = (£,—), then it's clear that the 
potential field on the line y = 0 due to the two charges at Q and Q is zero. 
Hence, Green's function would be the resultant field due to these two charges. 


3. Using the results of problem 2, what is the solution to Poisson's equation 
V?u = —k in the upper-half plane with zero BC? 

4. How would you go about constructing Green's function for the first quadrant 
x>0,y>0? 

5. An alternative approach to solving Poisson's equation that works sometimes 
is the following; suppose you want to solve: 


PDE Vu = 1 0<r<1 
BC u(18) -sn0  0zx60-x2m 


Start by trying to find any particular solution of V?u — 1 by substituting 
u,(r,8) = Ar? 


into the differential equation and solving for the constant. 

After finding a particular solution u,(7,6), consider letting u = w + u, 
and ask the question, what boundary-value problem will w(r,0) satisfy? 
After you determine this, solve for w(r,0). Finally, what is the answer u(r,0) 
of the original problem? Does it check? Look at the answer carefully; what 
is the interpretation of each term? 
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OTHER READING 


1. Introduction to Partial Differential Equations with Applications by E. C. Zachmanoglou and 
D. W. Thoe. Williams and Wilkins, 1976; Dover, 1986. More advanced than this book, but well- 
written with several examples; could be used for extra reading by serious students. 


2. Partial Differential Equations of Mathematical Physics by Tyn Myint-U. Elsevier, 
1973. A good discussion of Green's function. 
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Numerical and 
Approximate 
Methods 


LESSON 37 


Numerical Solutions (Elliptic 
Problems) 


PURPOSE OF LESSON: To show how a partial differential equation 
can be changed to a system of algebraic equations by replacing the partial 
derivatives in the differential equation with their finite-difference approx- 
imations. The system of algebraic equations can then be solved numerically 


by an iterative process in order to obtain an approximate solution to the 
PDE. 


It is also pointed out that the reader can obtain an existing computer 
package (ELLPACK) that will solve general elliptic problems. 


So far, we have studied several techniques for solving linear PDEs. However, 
most of the equations we've attacked were reasonably simple, had reasonably 
simple BCs, and had reasonably shaped domains. But many problems cannot 
be simplified to fit this general mold and must be solved by numerical approx- 
imations. Over the past ten years, scientists and engineers have begun to attack 
many more problems as a result of more computing power and more sophisti- 
cated numerical methods. Several new techniques have been developed to take 
advantage of high-speed computing machinery. Nonlinear problems in fluid 
dynamics, elasticity, and potential theory involving two and three dimensions 
are being solved today that were not even considered ten years ago. 

There are several procedures that come under the name of numerical methods. 
The reader can look in reference 1 of the recommended reading for a more 
complete discussion of these techniques. This lesson and the next two show how 
the very popular finite-difference method can be used to solve elliptic, hyperbolic, 
and parabolic equations. 

To begin, we introduce the idea of finite differences. We then show how to 
use these finite differences to solve a Dirichlet problem inside a square. 


Finite-Difference Approximations 


First, we recall the Taylor series expansion of a function f(x) 
f(x + h) = f(x) + fA + EO, deos 
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If we truncate this series after two terms, we have the approximation 


f(x + h) = f(x) + fh 
Hence, we can solve for f'(x) 


(37.1) f(x) = frs MIB 


which is called the forward-difference approximation to the first derivative f'(x). 
We could also replace h by — h in the Taylor series and arrive at the backward- 
difference approximation 


(37.2) f(x) = ULM 


or by subtracting 
f(x — h) = fix) - f'(x)h 
fix + h) = f(x) + fh 


we can obtain the central-difference approximation 


from 


(37.3) P(x) = = [fx + h) - fl - A)] 


By retaining another term in the Taylor series, this type of analysis can be 
extended to arrive at the central-difference approximation of the second deriv- 
ative f "(x) 


(37.4) f'G) = = [flr + h) ~ 26) + fle - h) 


We now extend the finite-difference approximations to partial derivatives. If 
we begin with the Taylor series expansion in two variables 


h? 
u(x + hy) = uly) + ux y)h + usQoyys t- 
fp 
u(x — hy) = uy) = uy) + uly) - - 
we can deduce the following: 


(Forward difference) 


"POT u(x + M — u(x,y) 
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(y) = lux + hy) = 2u(y) + ue — hy) 


ayy = u(x,y + 9 — u(x,y) 


uy) = Gluey + k) = 2u6) + uy = E) 


Which approximation to use (forward, central, or backward) depends on the 
problem, but in this lesson, we will use the central-difference approximation. 

To illustrate how to use these approximations, we consider the simple Dirich- 
let problem. 


Dirichlet Problem Solved by the Finite-Difference Method 
(37.5) PDE u,t+tuy=0 OK<x<1 DO<y<l 


u=0 On the top and sides of the square 


DES u(x,0) = sin (mx) 0xxx1 


We begin this problem by drawing the grid system on the xy-plane shown in 
Figure 37.1. 


J 


U mn 


O = known BC 


€ = interior grid 
points 


j changes ——>- 


FIGURE 371 Grid lines for the Dirichlet problem inside a square. 


It is also convenient (especially if we want to use a computer) to use the following 
notation: 


u(x,y) e Ui; j 
u(x,y + k) = Wiss, 
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u(x, y E k) zx Uj-,, 
u(x + h,y) = Uj 541 


u(x — hy) = Ui j-1 
1 
u,(x,y) = 2h (Uj p+ EE U, j 1) 


1 
uy (x, y) = 2k (Uji, ES Ui. 1j) 
(Central-difference formulas) 


] 

u,(x,y) = he (U, 41 = 2u, ; + u; ;—1) 
1 

Uy (X, y) x ke (ui. i; 2 2u; , + Uii) 


Our strategy for solving this Dirichlet problem is to replace the partial derivatives 
in Laplace’s equation 


+u, = 0 


Uxx yy 


by their finite-difference approximations. Doing this and using the compact 


notation u,,, we have the following difference equation: 
2 1 1 = 
Vu = h2 (ujj.i — 2U; + Uji) + k2 (u.i; — 2u; + u1) = 9 


By letting the two discretization sizes h and k be the same, Laplace’s equation 
is replaced by 


(37.6) (uisi, * Moa + Musa + uua 7 4u,;) = 0 


or solving for u;, 


1 
u,, = q Uu + Ua, t Ws. ct U, i 1) 


Note that here the u; s would stand for the solution at the interior grid points. 
This last equation says that we can approximate the solution u,» by averaging 
the solution at the four neighboring grid points. Hence, we can devise a numerical 
strategy for solving the problem. 


Numerical Algorithm for Solving the Dirichlet Problem 
(Liebmann's method) 


STEP 1 Seek the solution u,, at the interior grid points by setting them equal 
to the average of all the BCs (reasonable start). 
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STEP 2 Systematically run over all the interior grid points, replacing the old 
estimates by the average of its four neighbors. It doesn't make much difference 
in what order this process is carried out, but, generally, it is done in a row by 
row (or column by column) manner. After a few iterations, this process will 
converge to an approximate solution of the problem. The rate of change of this 
process is generally slow but can be speeded up in a number of ways; interested 
readers should consult reference 1 of the recommended reading. 


This completes the discussion of our Dirichlet problem; the reader is asked 
to carry out three iterations of Liebmann's method in the problems. 


NOTES 


1. If we write equations (37.6) for four interior grid points (that is, m — n 
— 4), we will get the four algebraic equations: 


—4u, + 0 + sin(m/3) + u4 + uy = 0 
(37.7) —4u,, + u, + sin (27/3) + 0+ uy, = 0 

—4u, + 0 + uw, + uz + 0 = 0 

—4u,, + Uy + u,+0+0=0 


from which we can solve for Un, U, U+, and u44. The solution of these 
equations can be found by iterative methods, and Liebmann's method is one 
of them. 

2. If we made our discretization sizes h and k smaller (so that we had more 
grid points), the analysis would be similar except that the system of algebraic 
equations (37.7) would be larger. In general, the number of equations will 
be equal to the number of interior grid points. 

3. The system of equations (37.7) can be written in matrix form 


—4 1 1 0 Uu — sin (17/3) — 0.86 
] -4 0 1 u» | _ | —sin (27/3) |] | —0.86 
1 0-4 1 Uy | 0 E 0 
0 1 1 —4 Us 0 0 


In general, when we have several equations (maybe 1,000) this coefficient 
matrix takes on a specific form with many zeros. The solution of these sparse 
systems of equations can be found by special numerical methods. Iterative 
procedures, such as Jacobi's method, Gauss Seidel, and successive over- 
relaxation (SOR) are commonly used (along with techniques for speeding 
up convergence). 

4. Tosolve the Neumann problem where there are derivatives on the boundary, 
we must also replace these derivatives by some finite difference approxi- 
mation. 
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5. We can also solve equations like: 
(a) wu, + u, = f(x,y) (Nonhomogeneous equations) 
(b) xu, + u,, + 2u = sin (x — y) (Variable coefficients; non- 
homogeneous) 
(c) sin xu, + u,, + 3u = 0 (Variable coefficients) 
by the finite-difference method. 

6. Ifthe domain of the problem is an irregularly shaped region, we can overlay 
the region with grid lines and then approximate the solution at nearby grid 
points by interpolating the boundary conditions. After doing this, we can 
proceed in the usual manner. See Figure 37.2. 


| ft | pee 
ttt htt A 
ate] | NN 
ry 
Nee EL 


Boundary conditions given 
on curve 


O= New BC found by 
interpolation of BC 
on curve 


FIGURE 37.2 


7. Several journals list computer programs for solving PDEs; some of them 
are: 

(a) ACM Transactions on Mathematical. Software 

(b) Computer Journal 

(c) Numerische Mathematik 

(d) BIT 
In addition, an extensive package of programs, called ELLPACK, has recently 
been designed for the purpose of solving fairly general elliptic boundary-value 
problems. This package will solve a wide variety of problems in two or three 
dimensions, various coordinate ms arbitrary boundaries, general BCs, by 
an assortment of different methods. * 


* Anyone interested in obtaining information about this program should contact Dr. 
John Rice, ELLPACK User's Guide CSD-TR 226, Computer Center, Purdue University, 
West Lafayette, Indiana 47907. 


306 Numerical and Approximate Methods 


PROBLEMS 


1. Derive approximation equation (37.4) for the second derivative f'(x) 
1 
f'G) = ilf + h) - 2/0) + fle h) 


2. Carry out the computation for two iterations in Dirichlet problem (37.5) 
using the Liebmann iterative process. Is the method converging? 

3. What algebraic equations must be solved when you use finite-difference 
approximations to solve the following Poisson equation inside the square: 


PDE Uu + Uy, = f(x,y) 0<x<1 0<y<1 
BC u(x,y) = g(x,y) On the boundary 


4. What algebraic equations must you solve when replacing the derivatives in 


PDE U + Uy + 2u = 0 0<x<1 0<y<1 
BC u(x,y) = g(x,y) On the boundary 


by their finite differences? 
5. How would you solve the Neumann problem inside the square 


PDE u,, tu, = 0 0<x<1 0<y<1 


u=0 On the top, bottom, and 
left-hand side of the square 


BC 
ou 
— (1 =f 0xyxl 


by the finite-difference method? 
6. Write a flow diagram to solve the Dirichlet problem inside the square 


PDE Ux + uy = f(x,y) 0cx«1 0<y<1 
BC u(x,y) = g(x,y) On the boundary 


with an arbitrary number of grid lines. If you know a computer language, 
write a program to carry out these computations. 


OTHER READING 


1. Numerical Methods for Partial Differential Equations by W. F. Ames. Academic 
Press, 1977. An up-to-date authoritative text on numerical techniques. 
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2. Numerical Analysis by S. S. Kunz. McGraw-Hill, 1964. Chapter 13 offers a clear, 
precise summary of some numerical methods in PDE theory. 


3. Numerical Solution of Partial Differential Equations by G. D. Smith. Oxford Uni- 
versity Press, 1965. A concise book describing finite difference methods in PDE theory; 
clearly written. 
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LESSON OO 


An Explicit Finite-Difference 
Method 


PURPOSE OF LESSON: To introduce the idea of explicit finite-dif- 


ference methods and show how they can be used to solve hyperbolic and 
parabolic problems. The basic idea is that after a PDE like 


u, =U 


XX 


is replaced by its finite-difference approximation, we can solve for the 


solution explicitly at one value of time in terms of the solution at earlier 
values of time. In this way, an initial-boundary-value problem (hyperbolic 
or parabolic) can be solved by consecutively finding the solution at larger 
and larger values of time. 

A problem we face is that as we make the grid sizes small so that the 
finite differences accurately represent the derivatives, the number of com- 
putations increases, and so the roundoff error increases. 


In the previous lesson, we solved elliptic boundary-value problems (steady-state 
problems) where the PDE was satisfied in a given region of space, and the 
solution (or its derivative) was specified on the boundary. In those types of 
problems, we found the approximate solution at the interior grid points by solving 
a system of algebraic equations. In other words, the solution at all the interior 
grid points was found simultaneously. 

In this lesson, we will show how time-dependent problems can be solved by 
finite-difference approximations. The idea here is that if we are given the solution 
when time is zero, we can then find the solution for t = At, 2At, 34t, . . . by 
means of a marching process. Replacing both the space and time derivatives by 
their finite-difference approximations, we can then solve for the solution u,, in 
the difference equation explicitly in terms of the solution at earlier values of 
time. This process is called an explicit-type marching process, since we find the 
solution at a single value of time in terms of the solution at earlier values of 
time. 

To show how this method works, we consider a representative problem from 
heat flow. 
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The Explicit Method for Parabolic Equations 


Consider the problem of heat flow along a rod initially at temperature zero, 
where the left end of the rod is fixed at temperature one, and the right-hand 
side experiences a heat loss (or gain) proportional to the difference between the 
temperature at that end and an outside temperature that is given by g(t). In 
other words, we solve the problem 


PDE U, = uy 0<x<1 0<t<% 
u(0,t) = 1 
BCs 0<t<% 
a = — [w1,) - 8] 


IC u(x,0) = 0 0xxxl1 


To solve this problem by finite differences, we start by drawing the usual rec- 
tangular grid system with grid points: 


See Figure 38.1. 


Typical computational 
molecule 


A 


I po: 


o, Nh 
MIN car 7 


U11 412 u13 Ura Uin 


FIGURE 38.1 Grid system for a heat-flow problem. 


Note that in Figure 38.1, the u;; on the left and bottom are given BCs and ICs, 
and our job is to find the other u, ij S- To do this, we begin by replacing the partial 
derivatives u, and u,, in the heat equation with their approximations 


[u(x,t + k) — ut) = 7 TONY - ui) 


= 
a |e 
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1 1 
7E ip [u(x + h,t) — 2u(x,t) + ux — ht] = y (Uji — QU; + Uji) 


xx 


By substituting these expressions into u, = u,, and solving for the solution at 
the largest value of time, we have 


k 
(38.2) Wien = Wt mg [ui — Uy + uii 


This is the formula we are looking for, since it gives us the solution at one value 
of time in terms of the solution at earlier values of time (note that the index i 
stands for time). Figure 38.1 shows those values of the solution that are involved 
in the formula. 

We are now almost ready to begin the computations. First, however, we must 
approximate the derivative in the right-hand BC 


u,(1,t) is [u(1,t) = g(t)] 
by 
(38.3) 7 lu, = Uni) = —(Uin — ] 


where g; = g(ik) is given. Note that we have replaced u,(1,t) by the backward- 
difference approximation, since the forward-difference approximation would re- 
quire knowing values of u;; outside the domain. Solving now for u,, in this BC 
gives us 


_ Uns + hg; 
(38.4) ge cm 


With this equation and our explicit formula (38.2), we are ready to begin the 
computations. 


Algorithm for the Explicit Method 


STEP 1 Find the solution at the grid points for £ = At by using the explicit 
formula 


k . 
JF u, |; + h2 [Us joa m 2u, j + Uz ja] L= 2 3, 1028609 JE. 7 1 
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See Figure 38.2. 


Key 


n - number of grid points 
in the x-direction 


m = number of grid points 
in the y-direction 


h= 1/(n - 1) 


k » T/(m - 1) 


FIGURE 38.2 Diagram illustrating the explicit method. 


STEP 2 Find u,,, from formula (38.4) 


"E UWz n-1 + hg. 
en 14A 


Steps 1 and 2 find the solution for t = At. To find the solution for t = 24At 


(second row from the bottom in Figure 38.2), repeat steps 1 and 2, moving up 
one more row (increase i by 1) and using the values of u,;, just computed; for 


t= 
In order for the reader to be able to computerize this method, we will present 


3At, 4At, . . . , keep repeating the same process. 


a fairly detailed flow diagram of the method in Figure 38.3. Those students not 
familiar with flow diagrams should think of them as links between computational 
algorithms and detailed computer programs. Flow diagrams explain in a precise 
manner how the computations should be carried out. 


NOTES 


l. 


There is a serious deficiency in the explicit method, for if the step size in 
t is large compared to the step size in x, then machine roundoff error can 
grow until it ruins the accuracy of the solution. The relative size of these 
two numbers x and ¢ depends on the particular equation and the BCs, but, 
generally, the step size in ¢ should be much smaller than the step size in x. 
In reference 3 of the recommended reading in Lesson 37, the author proves 
that we must have k/h? < 0.5 in order for this method to work. 

A general rule of thumb is that as the step sizes At and Ax are made smaller, 
the truncation error of approximating partial derivatives by finite differences 
decreases. However, the smaller these grid sizes, the more computations 
necessary, and, hence, the roundoff error, as a result of rounding off our 
computations, will increase. Therefore, we have the phenomenon illustrated 
in Figure 38.5. 
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Input: N = number of grid points in x-direction 
M = number of grid points in t-direction 


T » maximum value of t 
Gil-glt) ji-21,2,...,M 


Compute the step sizes: H = 1/(N - 1) 
K = T/(M - 1) 


Compute the ratio: R = K/H? 


Fill in the N ICs u(x, 0) = O the first row 


of an M X N array U = U(I, J). See Figure 38.4. 


Fill in the M BC 4(0,t) = 1 in the 
first column of the array U. 


Set the row counter / = 1. 


Compute: U(I* 1,7] U(L,J) +R (UU, J+ 1) -2U(L J) * U(1,J - 1)) 


for J=2,3,...,N-1 
U(I+ 1, N)  IUL* 1,N - 1) +HG (I+ 1)]/(H +1) 


Compute: 


Ist=M- 1? 


Yes 


We now have the approximate solution at the grid 
points, it’s up to the user how to display them. 


FIGURE 38.3 Flow diagram of the explicit method. 


3. The hyperbolic problem 


PDE uU, = Uu, 0<x<1 0ct«o 


(0,t) = gi(0 " 
BCs MM B A 0«ct« 


450-40) oera 
T bra = ye) OS*S I 
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(J=1,2,..., N) Boundary 
data 


gø 


t 


FIGURE 38.4 Arrays used in the explicit method. 


S LT 


Truncation error 


Roundoff error 


Grid size 


FIGURE 38.5 Total error as a function of grid size. 


can also be solved by the explicit finite-difference method. Here, we can 
approximate the derivatives u, and u,, by 


Un = 5 [u(x,t + k) — 2u(x,t) + u(x,t — k)] 


= lue + h,t) — 2u(x,t) + u(x — h,t)] 


u,, = 


and the derivative u,(x,0) in the IC by 


(9,0) = [u(x k) — u(x 0)] = 7 (ule) = 660) 
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Hence, solving for u(x,t + k) explicitly in terms of the solution at earlier 
values of time gives 


u(x,t + k) = 2u(x,t) — u(x,t — k) 
(38.5) 2 
+ n [u(x + h,t) — 2u(x,t) + u(x — hd] 
From this equation, it is clear that we must already know the solution at 


two previous time steps, and, hence, we must use the initial-velocity con- 
dition 


= [u(x,k) - 6) = ya) 


to get us started. Solving for u(x,k) gives u(x, k) = o(x) + kw(x), and, thus, 
we can find the solution for t = At. The solution at all later values of time 
can now be found by our explicit formula (38.5). 


PROBLEMS 


1. Find the finite-difference solution of the heat-conduction problem 


PDE U, = U,, O<x<1 O0<t<o 
u(0,t) = 0 
BCs pest zu 0crt«o 


IC u(x,0) = sin (mx) 0xxxl 


for t = 0.005, 0.010, 0.015 by the explicit method. Let ^ = Ax = 0.1. Plot 


the solution at x = 0, 0.1, 0.2,0.3,...,0.9, 1 fort = 0.015. 
2. Solve problem 1 analytically (separation of variables) and evaluate the an- 
alytical solution at the grid points: x = 0,0.1,0.2,... ,0.9, 1 fort = 0.015. 


Compare these results to your numerical solution in problem 1. (You may 
wish to write a small computer program or use a calculator to evaluate the 
separation-of-variables solution.) | 

3. Write a flow diagram to carry out the computations of the hyperbolic prob- 
lem discussed in note 3 of this lesson. 

4. Do problem 1 except now replace the BC at x = 1 by 


u,(1,t) = — [w(1,t) — 1] 
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OTHER READING 


Finite-Difference Methods for PDEs by G. F. Forsythe and W. R. Wasow. John Wiley 
& Sons, 1960. An excellent text with several physical examples illustrated, soil-drainage 
problems, oil-flow problems, and a meteorological-forecast problem are a few of the 
problems discussed. 


316 Numerical and Approximate Methods 


LESSON 39 


An Implicit Finite-Difference 
Method (Crank-Nicolson Method) 


PURPOSE OF LESSON: To show how time-dependent problems can 
be solved by another finite-difference scheme known as implicit methods. 
In this method, we again replace the partial derivatives in the problem by 
their finite-difference approximations, but unlike explicit methods (where 
we solved for u, , , ; explicitly in terms of earlier values), in implicit methods, 
we solve a system of equations in order to find the solution at the largest 


value of time. In other words, for each new value of time we solve a system 
of algebraic equations to find all the values. 

Implicit methods have an advantage over explicit ones, since the step 
size can be made larger without worrying about excessive buildup of round- 
off error. 

A popular implicit method known as the Crank-Nicholson method will 
be used to solve a parabolic problem. 


The difficulty with the explicit methods that we discussed in the last lesson is 
that the step size in time must be small in order for the method to work properly. 
In particular, if we were to solve the simple heat-flow problem 


PDE u, =U O<x<1 O<t<« 


u(0,t) = g,(t) 
(39.1) BC PEE e) 0crt«o 


IC u(x,0) = f(x) 0zxzxl1 


by the explicit method, it would be necessary for the grid sizes At and Ax to 
satisfy 


At 
(Ax)? 


= 0.5 
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in order for the method to be numerically stable (the roundoff errors don't build 
up). See reference 1 (p. 45) of the recommended reading for details of numerical 
stability. In other words, if the grid size Ax in the x-direction were chosen to 
be Ax = 0.1, then the time increment At must be At < 0.5Ax? = 0.005 (hence, 
to go from t = 0 tot = 1 would take 200 steps). 

There are, however, procedures (implicit methods) that allow us to take larger 
steps by doing more work per step; in these methods, we can take relatively 
large steps by solving a system of algebraic equations at each step. To illustrate 
how these methods work, we solve the following heat-flow problem. 


The Heat-Flow Problem Solved by an Implicit Method 


Consider the following problem: 


PDE U, = Ux 0<x<1 0O<t<ax 
u(0,t) = 0 
(39.2) BCs E -0 0<t<x 


k am E 
: 0 WIZPPP P, gy PPP PPP 9s 0 
41 ae 
poy = 
iH molecule v n 
E 
cee Uz, = 0 


V/ A A 
EN BH 
x 


FIGURE 394 Grid system for implicit scheme (Ax = 0.2). 
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We replace the partial derivatives u, and u,, by the following approximations: 


u(x,t) = = [ult + k) — u(x,t] 


u(x,t) = [u(x + h,t + k) — 2u(x,t + k) + u(x — ht + k)] 
(1 — A) 


s E 


[u(x + ht) — 2u(x,t) + u(x — ht] 


where à is a chosen number in the interval [0,1]. Note that our approximation 
for u,, is a weighted average of the central-difference approximation to the 
derivative u, at time values ¢ and £ + k. In the special case when A = 0.5, it 
is just the ordinary average of these two central differences, while if A = 0.75, 
our approximation puts weights of 0.75 and 0.25 on each of the two terms (note, 
if X = O, it is the usual explicit finite-difference method we used in the last 
lesson). 

If we now substitute the approximations for u, and u,, into our problem, we 
get the new finite-difference problem 


Difference 1 


equation mox ig = U; j) 


(1 — X 
h2 


A 
= pais tit m 2U;.1j + Uis 1-1) F (Ui ja) = 2u, ; + U, i1) 


(39.3) 


UJ 
C 
qe 
= Ss 
sy jH 

Il 

CO C 
Il 
— 
i 
3 


See Figure 39.1. 


Now, if we rewrite the difference equation in (39.3), putting the u; s with the 
largest time subscript (i-subscript) on the left-hand side of the equation, we 
arrive at the equation 


(39.4) — rU; ijui T (1 + 2rh)u;,,; — ATU 41 5-1 
=r(1 — Xu, + [1 - 2r - Nu; + rd — Nui. 


where we have set r = k/h? for convenience. Note that for a fixed subscript i 
and for j going from 2 ton — 1, this is a system of n — 2 equations in then — 2 
unknowns U;,,5, Ujsi3> Ui+ias - - Ui+in-1 [Which are the interior grid points 
att = (i + l)AI]. 
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To help show exactly what u,,’s are involved in this formula, we write it in 
the symbolic or molecular form shown in Figure 39.2. 


Three 
iti D * (+ 2n) T GAA) unknowns 
l Three 
TD * Q0 29 known 


FIGURE 39.2 The molecular form of the implicit formula. 


We now show how equation (39.4) can be used to find the solution of problem 
(39.2). 


Implicit Algorithm for Heat Problem (39.2) 


STEP 1 Pick some value for à (0 < A < 1). Note that if à = 0, then equation 
(39.4) is the same as the explicit formula we developed in lesson 38. 


STEP 2 Pick h = Ax = 0.2 and k = At = 0.08 (r = klk? = 2). This gives six 
grid points in the x-direction (four interior grid points); see Figure 39.1. Also 
let’s pick the weight parameter à = 0.5 (which is called the Crank-Nicolson 
method). If we now apply our computational molecule to the first and second 
rows (i = 1), moving it from left to right (j = 2, 3, 4, 5), we get the following 
four equations: 


— ün t Ju — uj = Un — Uy + Uy = 
— ün t Ju; — uj = Ug — Ug + Ua = 


— Un + Ju — Us = Mj — Ua, + Uys = 


EA RA m E 


—Uy, t Ju; — uy, = Uy — Uys + Uis = 


which if written in matrix form, placing the four unknown interior grid points 
Uz, Uz3, Uz4, and us on the left-hand side of the equation, gives 


(39.5) 


| 

Ee 
G2 
| 

RÀ 
e 
= 
o 

mM m po 
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This system of equations is called a tridiagonal system, and to solve it, we use 
a method that transforms a tridiagonal system of the form 


b c, 0 0 S E: 0 X: d, 

a b G 0 ES 0 x. d, 

0 a, b €; 0 0 X3 d, 
C4-1 

0 0 0 d, | b, X. d, 


into an equivalent one 


1c O0 0 0 Xs d, 
0 1 c 0 >.. 0 x d, 
00 1 ĉi 0 X3 d, 
Cai 
0 0 0 1 X, d, 
where 
C. 
- "pm D—ÀÀ—À |2z1,2,...,n—-2 
Ci Cilb, Cj+1 bj. E aC; J ? n 
and 
d, = d,/b, di 2 On. ] 9 2, nd 


There is nothing magical about this transformation; it just involves rewriting the 
original system of equations in an equivalent form. The point is, once we have 
written the system of equations in the new form, it is easy to solve. Solving from 
bottom to top, we have 


x, = d, x, = d; — CjXj.4 j2»n-1, n-2,...,2,1 


Applying this method to our system of four equations (39.5), we get: 


u» = 0.60 
u» = 0.80 
uj, = 0.80 
u; = 0.60 
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This gives us the solution (approximation) at the interior grid points for t = Ar. 
After finding these values, we move to the next time value and solve a new set 
of equations. 

This implicit method takes more work at each value of time than does the 
explicit method, but it enables us to pick a larger At and still get a good ap- 
proximation. 


PROBLEMS 


1. Derive equation (39.4) from the difference equation in (39.3). 
2. Tell how you would solve the problem 


PDE u, = U,, 0<x<1 


(0,4) = 1 A 
m be tuah =e S'S 


IC u(x,0)=0 Osx<1 


by the implicit finite-difference method. 
3. How would you solve 


by the implicit method? 

4. What is the molecular form of equation (39.4) when we pick à = 1? 

5. Write a flow diagram to solve heat-flow problem (39.2). Write a computer 
program if facilities are available. A good experiment would be to solve this 
problem numerically with a simple IC u(x,0) = sin (mx) for different values 
of the parameter à. You could compare the true analytical solution, which, 
in this case, is 


u(x,t) = e-"" sin (nx) 
with the numerical solution for different values of A. 


6. Solve the system of algebraic equations (39.5) using the formulas given in 
the lesson. 
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OTHER READING 


Numerical Methods in PDEs by W. F. Ames. Academic Press, 1977. An excellent book 
with applications to fluid dynamics and elasticity. 
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LESSON 40 


Analytic versus Numerical 
Solutions 


PURPOSE OF LESSON: To discuss the relative merits and demerits 


of analytic and numerical solutions to PDEs. The importance of mathe- 


matical models in identifying physical quantities (parameter identification) 
is presented, and an important example from biology is discussed. 


It’s probably time we had a discussion about the relative merits and demerits 
of analytic and numerical solutions. First of all, let’s make sure we know what 
we mean when we talk about these types of solutions. 


Meaning of Analytic Solutions 


Analytic solutions are those solutions where the unknown variable u is given as 
a mathematical expression in terms of the independent variables and parameters 
of the system which are generally infinite series or integrals. 


Meaning of Numerical Solutions 


Numerical solutions, on the other hand, refer to finding the solution of PDEs 
by replacing the differential equation with an approximate equation and solving 
the easier one. For example, the method of finite-difference approximations 
replaces partial derivatives with finite differences, so we approximate the solution 
to a PDE by solving a finite-difference equation. The result is generally a table 
of numbers listing the solution u for various values of the independent variables. 

Now that we know the basic meaning of the two types of solutions, let’s ask 
which is better. 
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Comparing Numerical and Analytic Solutions 


Suppose we have the simple parabolic IBVP 


PDE u, = a?u 


0cx«1 0ct«o 


whose solution is shown in Figure 40.1. 


u 


0 


i 
[e] 


x 
1 


FIGURE 404 Solution of heat equation (40.1) for various values of time. 


The question here is, would we rather be given the analytic solution 


to the problem or the numerical solution (with a — 1)? 


TABLE 40.1 


01 02 03 04 05 06 07 08 09 


X 
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This is a good question; the answer depends on what we want to do with the 
solution. There are, however, some clear cut advantages to each of the two 
types of solutions; first the advantages. 


Advantages of the Analytic Solution 


1. Equation (40.2) obviously contains more information than a table of 
numbers. If we wanted to evaluate the solution at any specific point (x,t), 
we could do so with any degree of accuracy merely by adding a sufficient 
number of terms in the infinite series. An upper bound on the error could 
be found without much difficulty. 

2. The analytic solution allows us to find the solution at a single point (x,t) 
without going through the entire marching process of finding the solution 
at all other points, as we did in the explicit and implicit methods. 

3. The analytic solution allows us to find the solution at any point and not 
just the grid points. 

4. Probably most important of all, the analytic solution tells us how physical 
parameters, initial and boundary conditions affect the solution. 

Numerical solutions do not bring out these interrelationships, since we are 

finding the numeric solution for specific parameters, initial and boundary con- 
ditions. In many situations, it is critical to know the relationship between the 
parameters of the model and the solution, since our goal may be to estimate the 
parameters from the solution. For example, suppose we measure the solution u 
experimentally, and we know the analytic solution 


u = function of the parameters 


then we can more or less solve for the parameters as a function of the data via 
parameters = function of u = function of the data 


This concept is called parameter identification, and it is one of the major 
reasons for solving PDEs. Later on in this lesson, we give an important example 
of parameter identification in biology. First, however, let's see why numerical 
solutions are worthwhile. 


Advantages of Numerical Solutions 


There is one major advantage to numerical solutions, and it is that many prob- 
lems do not have known analytic solutions. Practically all nonlinear PDEs must 
be solved by numerical methods, and, in fact, most realistic models in physics, 
chemistry, biology, and so forth, are nonlinear in nature. The linear models 
represent, for the most part, approximations where we have thrown out certain 
nonlinear components. Some very important nonlinear equations such as: 
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1. Nonlinear wave equation Hu, = U, + flu) 
2. Reaction-diffusion equation uU, = u,, + f(u) 


n . U, = Uy, + flu,v) 
3. Hodgkin-Huxley equations b = g(u,v) 


do not have known analytic solutions for all nonlinearities f and g. Hence, the 
general attack for most nonlinear problems (and some linear ones) involves the 
use of numerical solutions. 

We now consider an example of how analytic solutions can be used to find 
important physical parameters. More details of this problem can be found in 
the recommended reading. 


Parameter Identification (in Biology) 


Suppose a biologist is trying to determine how fast potassium ions (K *) diffuse 
in an exoplasm solution. By knowing the diffusion coefficient, we can tell a lot 
about how nerve impulses are transmitted along axons. The problem is that this 
coefficient is practically impossible to measure directly. What we can do, how- 
ever, is find a mathematical relationship between the potassium concentration 
u(x,t) and the diffusion coefficient D, so that by measuring u(x,t), we can find 
D. The following example shows how this works. 

Biologists Hodgkin and Keyes found that after isolating giant squid axons in 
a special salt solution, the concentration of radioactive potassium (*K) along 
the axons could initially be approximated by the curve 


u(x,0) = Ae-*^ 


In other words, the parameters A and a in the curve were found so that the 
equation fit the observed data points (least-squares fit). See Figure 40.2. 


0 
FIGURE 40.2 Initial concentration of 47K. 
It was also determined that after this initial concentration, the concentration in 
a normal environment flowed down the axon both by convection and diffusion. 


Hence, Hodgkin and Keyes assumed the concentration u could be described by 
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the convection-diffusion IVP 


(40.3) PDE u, — Du,, — Vu, -0 « x « o 
IC  u(x0)24A4e"*^"  -ocxc«o 


This problem was solved in Lesson 15 by transforming into moving coordinates. 
If the reader remembers, the general idea of moving coordinates was to forget 
V and solve the pure diffusion problem to get 


oc 


UE AE N 


] Ava 
^ Va + 4Dt 


e^ E?/a e-e- £)?/4Dt dt 


e^ [x2/(a+ 4Dr)] 


(which is the solution to the problem with V = 0). Substituting x — Vt for x 
gives the solution to problem (40.3); namely, 


ANa 
(40.4) u(x, t) = Ava e- (6 - V0?(a* 4DID] 


va + 4Dt 


It turned out that Hodgkin and Keyes were able to measure V directly, so that 
equation (40.4) gives a relationship between *K concentration and the diffusion 
coefficient D (A,a, and V are all known). By designing an experiment where 
they measured the potassium concentration u(x,t) at some fixed point x, along 
the axon at different values of time, they were able to find the value of D that 
made the theoretical curve (40.4) fit the data (Figure 40.3). 


u(xo , t) 


t (Time) 


FIGURE 40.3 Fitting the curve u(x;,f) to the observed data points. 


In other words, if we pick various values of the diffusion coefficient D, we get 
different curves u(x,,t). Hence, we pick the value of D that makes the solution 
to the PDE fit the experimental data. In their experiment, Hodgkin and Keyes 
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found that the diffusion coefficient of K+ in exoplasm was D = 1.5 x 10^? 
cm?/sec. 


PROBLEMS 


1. How could you construct an experiment to estimate the parameter a in 
problem (40.1) using analytic solution (40.2)? 

2. Least-squares approximations minimize the sum of squares (SS) between 
the curve and the data points. For example, the least-squares line y(x) = 
a + bx that approximates data points (x,,y,), (x5,y3), . . . (x, y,) would be 
the specific line that minimizes (see Figure 40.4). 


ix, Yn) 


FIGURE 40.4 Least-squares approximation at data points. 


ss = Y fy, - (a + bx)P 


Find constants a and b in terms of the data points (x; y;) so that this line is 
the least-squares approximation. 

3. Animportant problem in biochemistry is determining the molecular weight 
of the macromolecule myoglobin. One approach is to place a certain blood 
solution into an ultracentrifuge (very fast centrifuge) and spin it for a given 
length of time. The equation that describes the concentration of the liquid 
in the centrifuge is known as Lamm's equation: 


1 9 
u, = — — (Dru, — so?r?u 0«r«1 
, = Š (Dru, ~ seru) 


where 
r = distance from the center of the centrifuge 


D =diffusion coefficient (depends on the molecular weight of myoglobin) 
s = sedimentation coefficient (computed experimentally) 

w = angular velocity of the centrifuge (known) 

u(r,t) = concentration of the medium in the centrifuge 


The approach in finding the molecular weight of myoglobin is to find the 
steady-state solution u(r,o») of Lamm's equation by letting u, = 0 and solving 
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the ODE for u(r,~). The question is, how do you design an experiment 
using this steady-state solution u(r,œ) to estimate the molecular weight of 
myoglobin? 


OTHER READING 


Introduction to Mathematical Biology by S. I. Rubinow. John Wiley & Sons, 1976. Several 
applications of PDEs to biology are given in this text. 
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LESSON 44 


Classification of PDEs (Parabolic 
and Elliptic Equations) 


PURPOSE OF LESSON: To introduce a new coordinate system (£m) 


intc the second-order linear equation 
Au, + Bu,, + Cu,, + Du, + Eu, + Fu = 
for the cases 


B — 4AC = 0 (Parabolic case) 
B? — 4AC <0 (Elliptic case) 


and in each case, show how the equation can be written in one of the two 
canonical forms 


Un, = (E, N, U, Ug Un) (Parabolic canonical form) 
Ug + Up, = (EN, U, upu) (Elliptic canonical form) 


In Lesson 23, we classified the general second-order linear equation in two 
variables 


(41.1) Au, + Bu, + Cu, + Du, + Eu, + Fu = G 


as one of three basic types and, in particular, transformed the hyperbolic equation 
into its two canonical forms. 

In this lesson, we will show how parabolic and elliptic equations can also be 
reduced to canonical form. 


Reducing Parabolic Equations to Canonical Form 


In this case, we consider equations of the form (41.1) with B? — 4AC = 0 and 
introduce new coordinates (&,n), so that the equation takes the form 


Urn n (E, n, U, Ug, U) 
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Introducing new coordinates £ = (x,y) and n = (x,y) into equation (41.1) 
gives us the same equation as before; namely, 


(41.2) Au, + Bu, + Cu, + Du, + Eu, + Fu = G 
where: 
A = Ag + B&£, + CE 
B = 2A&n, + Blm, + Em) + 2C&n, 
C = Ani + Bn, + Cn; 
(41.3) D = A&, + BẸ, + CE, + DE, + Et, 
E = An, + Bn, + Cn, + Dn, + En, 
F =F 
G=G 


However, our goal now is to set B and either A or C equal to zero and solve 
for £ and 1 (we can see in a moment that B? — 4AC must be zero in order to 
carry out this plan). Here, we'll set A and B equal to zero and solve the resulting 
equations. First, setting A = 0 and solving for [&,/é,] we have 


[E/5] = —B/2A 


Hence, we can find the coordinate & = &(x,y) that satisfies this equation by 
setting 


Ys " 
dx m [E/E] = B/2A 


and finding the implicit solution 


E(x,y) = c 
to this equation. 
d 

For example, if = B/2A = 3, then we have y — 3x = c, and, hence, (x,y) 
= y — 3x satisfies £/£, = —3 (and, thus, makes A = 0). 
__ So, we are half done; we have found one coordinate & = &(x,y) that makes 
A = 0. The last part of the problem is to find «(x,y) so that B = 0. 

Here's where we get a break. It turns out (since B? — 4AC = 0) that by 


picking € so that A = 0, the coefficient B is automatically zero. In fact, we'll 
verify this right now, The coefficient B is given by 


B = 2AE,N, T B(&n, + Ej.) T 2C&, 
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and since B? — 4AC = O0, we can write 
B = 2(VA& + VCE) (VAn, + VCn,) 
and since &/€, = —B/2A = -2 VAC/2A = — V CIA, we have 
B=2 Val Van, + Ven, 
which, of course, is zero because A is Zero. 

So, by our choice of £, both A and B are zero, and, hence, we can pick « any 
way we like (as long as it's never parallel to the & coordinate). Thus, we can 
pick something simple like yn = y. 

All that remains is to find the new canonical equation, and to get this, we 
merely substitute € and y into equations (41.3) to find the coefficients A, B, C, 


D, E, F, and G. This finishes the parabolic case; before going onto another 
topic, we present a simple example. 


Transforming the Parabolic Equation u,, + 2u,, + u,, = 
0 into Canonical Form 
We begin with the simple equation 

Uu + 2u,, + uy = 0 
where A = 1,B =2,C =1,D= E = F= G = Q. Hence, B? — 4AC = 0 
for all x and y. To find the new coordinates & and y and the canonical equation, 


we proceed as follows: 


STEP 1 Write the characteristic equation (only one now) 
— = — [E/£] = BRA = 1 


Solving for y (integrating) gives 
y=x+c 


and, hence, = y — x will satisfy the characteristic equation and thus make A 


The ņ coordinate can be chosen in any way, as long as it isn't parallel to the 
€ coordinate; hence we choose 


n= yYy 
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The new coordinates 


(41.4) 


are shown in Figure 41.1. 


£ = constant 
7 = constant 


FIGURE 41.1 New coordinate system £ = y — X,» = y. 


y into the new coefficients A, B, C, D, E, F, and G gives: 


A = 0 (Must be true; we set it equal to zero and solved for ë) 
B=0 (We have already shown that this is zero) 
C = An + Bn, + Cj = 1 
(41.5) D = A&, + BE, + C&, + DE + Eg, = 0 
E = An,, + Bw, + C, + Dn, + En, = 0 
F=F=0 
G=G=0 


Hence, our new equation 
Aug, T Bu,, + Cu, T Du, T Eu, + Fu =G 


is simply 


This completes the example. Before going on, let’s look for a moment at this 
canonical form. This equation is so simple that we can find its general solution 
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(all its solutions). Starting with u,, = 0 and integrating once with respect 
to y gives 


un = fE) 


where f(£) is an arbitrary function of &. Integrating again gives the general 
solution 


u(&m) = nf) + g(£) 
where g(£) is another arbitrary function of &. (The reader can easily verify that 
any function of this form is a solution of u,, = 0.) 
Now the final step. Substituting the terms of our original coordinates x 
and y gives the general solution of 


u,, + 2u, + uy, = 0 


namely, 
u(x,y) = yfly — x) + gy — x) 

For example, if we pick f(x) = sin x and g(x) = x* at random, then 

u(x,y) = ysin (y — x) + (y — xy 
should be one of the infinitely many solutions of the equation (of course, which 
solution actually models the physical problem depends on the initial and bound- 
ary conditions). 
Reducing Elliptic Equations to Canonical Form 
We start again with the general equation 


Au, + Bu, + Cu,, + Du, + Eu, + Fu = G 


but now B? — 4AC < 0. Our goal is to transform this equation into the new 
form 


Ug t Um = P(E, n U, Ug, Un) 


by changing the independent variables. Proceeding as we did in the two earlier 
cases, we are tempted to set A = C and B = O in the transformed equation 


Au, + Bu, + Cu,, + Du, + Eu, + Fu = G 
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and solve for & and n. Unfortunately, these equations (A — C = 0, B = 0) do 
not allow us to solve for & and ņ as the earlier ones did, and for that reason, we 
proceed a little differently. 

We find our transformation & = (x,y), n = m(x,y) as a composition of two 
transformations; we start with the first. 


Transformation 1 


We first make a transformation to new coordinates & and ņ that will make our 
equation look like 


Uc. v WE, ur u, Ux, Uu.) 


It is possible to do this, but we must resort to complex coordinates. To find these 
complex coordinates € and n, we merely proceed as we did in the hyperbolic 
case by solving the characteristic equations 


dy B - v B? — 4AC 


dx 2A 

(Remember B? — 4AC < 0) 
dy B + VB? — 4AC 
dx 2A 


to get 


E(x,y) = constant 
(x,y) = constant 


For example, the characteristic equations 


D esed =i 
dx 

d 

Y= V-ae = 2ix 

dx 


would give us the complex conjugate coordinates 


= y + ix? 
qzy- ix 
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Transformation 2 


We now make a second transformation from (£,n) to (a,) via 


NEN e 

2 
IN ex 
s 2i 


and the result of this second transformation changes the first equation 
Ug, = WEN, U, Uy Uy) 
to the final form 
Usa + Ugg = (o, B, U, Uw ug) 
where 4 and y are the general names for the right hands. 


Instead of showing that these two transformations (back to back) actually carry 
out the above result, let's apply these principles to a simple example. 


Changing the Equation y?u,, + x?u,, = 0 to Canonical 
orm 


Consider transforming the equation 

yu, + x'u, = 0 
where A = y, B = 0, C = x*, D = E = F= G = Q0. The discriminant B? 
— 4AC is equal to —4x’y?, and, hence, we will transform this equation to 
canonical form in the first quadrant x > 0, y > 0. 
STEP 4 (First transformation) 


We start by writing the two characteristic equations 


dy B-VB-4AC vV- 


Ri d = —Ix/ 
dx 2A 2y? icd 
dy B+ VB —-4AC wv-4Axy _ 
dx 2A mng Te 
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Solving these equations by separating variables, we have the implicit relationship 


y? + ix? = constant 
y? — ix? = constant 


and, hence, 


E(x,y) = y! + ix? 
(x,y) = y? — ix? 


(It doesn't really matter which function we call € and n; we could interchange 


the two if we wanted.) This transformation will reduce the original equation to 
the form 


Uen " WE, T, uU, Ug, Un) 


We don’t really care about this equation (which is a complex hyperbolic equa- 
tion), and so we continue with the second transformation. 


STEP 2 (Second transformation) 


Making the second transformation, we have 


a = £ 2 - y? (Real part of € and n) 
E us! E 
p = 2) 0 (Complex part of € and n) 


From a notational point of view, it might be best to rename the variables (o,Q) 
as (€,y) and think of our composite transformation as simply being 


&xy-y nw, y) = x 


STEP 3 (Finding the new equation) 
The new canonical form can be found by computing the coefficients A, B, C, 
D, E, F, and G in the equation 


Au, + Bu,, + Cu,, + Du, + Eu, + Fu = G 


from equations (41.5) with € = y? and yn = x’. Doing this gives the elliptic 
canonical form 


—tu, — nu 
Use t Un = = ee 


338 Numerical and Approximate Methods 


NOTES 


1. Second-order linear equations in three or more variables can also be classified 
except that we must use matrix analysis. For instance, the second-order 
equation in three variables 


U, = u,, + Uy 


would be classified as a parabolic equation, while the equation 


would be a hyperbolic equation. 

2. Our interest in classifying PDEs is in part due to the fact that the three basic 
types describe different kinds of physical phenomena, and we would like to 
classify mathematically these three types of physical problems. 


PROBLEMS 


1. Which of the following parabolic and elliptic equations are already in can- 
onical form: 


(a) u =u 
(b) uy + u,, + 3u = sinx 
(c) ux + 2u, = 0 

(d) u,, = sin x 


2. Transform the parabolic equation u,, + 2u,, + u,, + u = 2 into canonical 
form. 

3. Transform the elliptic equation u,, + 2u,, + x^u, = e^" into canonical 
form. 


OTHER READING 


1. Second-Order Partial Differential Equations by M. M. Smirnov. Noordhoff, 1966. 
A small, well-written book; in addition to classifying second-order equations in two 
variables, he also classifies second-order equations in n variables. 

2. Methods of Mathematical Physics, vol. 2 by R. Courant, and D. Hilbert. Wiley/ 
Interscience, 1962. One of the most famous books on PDE theory written by two of the 
most outstanding mathematicians of this century; more advanced than this book, but 
contains a wealth of information for any reader willing to spend the time. 
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LESSON 42 


Monte Carlo Methods (an 
Introduction) 


PURPOSE OF LESSON: To explain the basic philosophy of Monte 


Carlo methods and suggest how they can be used to solve various problems. 
The basic idea here is that games of chance can be played (generally on 
a computer) whose outcomes approximate solutions to real-world prob- 
lems. A simple example would be evaluating the integral 


1 
r= | gd 
0 


by throwing darts at the unit square {(x,y):0<x<1,0<y< 1). After 
100 tosses or so, we use the fraction of darts under the curve y = x? to 
approximate the integral. Generating a random game (like tossing darts) 
always involves generating a sequence of random numbers, and so a pro- 
cedure for their generation is described. 


There is an interesting technique known as the Monte Carlo method (or methods) 
that can be used to solve many types of problems. Here, we present a brief 
overview of the method and then, in the next lesson, illustrate its use in PDEs. 

First of all Monte Carlo methods are procedures for solving nonprobabilistic- 
type problems (problems whose outcome does not depend on chance) by prob- 
abilistic-type methods (methods whose outcome depends on chance). The general 
philosophy of these methods is illustrated in Figure 42.1. 


Probabilistic game Deterministic problem 


The outcome of the game p. The answer to the problem is p. 


(Like the fraction of heads in tossing a (Like evaluating an integral, solving a PDE, 
coin, throwing darts, and so forth) and so forth) 


Approximation 
Outcome = f ———» Answer = p 


FIGURE 421 General philosophy of Monte Carlo method. 
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Evaluating an integral 


To illustrate this method, suppose we wanted to evaluate the integral 


[= ET dx 


(a nonprobabilistic problem). To use the Monte Carlo method, we would devise 
a game of chance whose outcome was the value of the integral (or approximates 
the integral). There are, of course, many games that we could devise; the actual 
game we used would depend on the accuracy of the approximation, simplicity 
of the game, and so on. An obvious game to evaluate the integral would be 
throwing darts at the rectangle R = {(x,y):a <x <b, 0 < y < max f(x)} (Figure 
42.2). 


M = max f(x) 


e ` ° , sr o , ad Ld 9. 
SIN OM vec. a tn d.a art ha Ok Otis ` oy ME Se. 8 


= darts hitting above the curve 
- darts hitting below the curve 


FIGURE 42.2 Evaluation of an integral by the Monte Carlo method. 


It's fairly obvious that if we randomly toss 100 or so darts at the rectangle R 
enclosing the graph, then the fraction of darts hitting below the curve times the 
area of R will estimate the value of the integral. Hence, our outcome of the 
game 


Í = [fraction of tosses under f(x)] x (area of R) 


is used to estimate the true value of the integral Z. 

To carry out the actual computation on a computer, we would have to generate 
the sequence of random points in some way (we'll discuss this shortly) and have 
the computer play the dart tossing game. Let us assume for the time being that 
we have a sequence of random points. The flow diagram in Figure 42.3 illustrates 
how the computer would attack this problem. 
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Generate two random numbers 


O<r, <1 
O<r,<1 


Compute 


x =at(b—a)?, 
y = Mr, 
M = max f(x) 


(gives a random point (x, y) 
in the rectangle R) 


Under = Under + 1 


en 


Integral = (Under/100] M(b — a) 


b 
FIGURE 42.3 Flow diagram to evaluate | fx)jdx by the Monte Carlo 
method (100 tosses). 


Random Numbers 


Before going on to apply this technique to the solution of PDEs in the next 
lesson, we discuss the important topic of random numbers. In the integral just 
considered, it was necessary to generate a sequence of random points P, = (x,,y,) 
that fell inside rectangle R. In other words, the x-coordinate would have to be 
a random number in the interval [a,b], while y; must be in [0,M]. To find random 
numbers inside specific intervals, we start with a basic sequence of random 
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numbers r; (uniformly distributed) inside [0,1]. It's obvious then that if we want 
a random number x, inside [a,b], we just compute 


x, =a + (b — ay, 


So everything comes down to the question, how do we generate a sequence of 
random numbers ír: i = 1, 2, .. .) uniformly distributed in [0,1]. The most 
common method in use today is the residue (or congruential) method. This 
method generates a sequence of random integers (like 2120, 1401, 177, 3013, 
.. .)3 then, by placing a decimal to the left of these numbers, they become 
numbers between zero and one (like .212, .1401, .0177, .3013, . . .). 

So, to generate a sequence of random integers (between 0 and P, here), we 
use the residue algorithm. 


Residue Algorithm for Generating Random Numbers 


1. Pick the first random integer any way you like between 0 and P (P was 
picked in advance). 

2. Multiply this random integer by some fixed integer M (picked in advance). 

3. Add to that product another fixed integer K (picked in advance). 

4. Divide the resulting sum by P and pick the remainder as the new random 
integer. Now go back to step 2 and repeat steps 2-4 until you have enough 
random integers. 

This residue algorithm can be written as 


r1 = (Mr, + K)mod P DE 0CL.2 23 


which says, if we are given a random integer r,, then to compute a new one 
r,,,, we multiply by M, add K, divide by P, and pick the remainder. For example, 


if: 
P = 100 
M = 37 
K = 16 
ry = 15 


Mr, + K = 571 Y 
J —> r, = 43 
Mr, + K = 2643 X 
g ——> ñ =? 
Mr, + K = 1607 y 


-e ae am m e —  — —— ee ee — —À es oe —À 
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Note that since P — 100, all the integers are between zero and 100 (the so-called 
residue class of remainders). By placing a decimal in front of these integers, we 
get the sequence of random numbers between zero and one: 


ry = .15 
ru 
p, = .43 
r, = .07 (We also call these numbers r;). 
NOTES 
1. Since we are dividing by P = 100 in our random-number generator, the 


remainders will be one of the integers 0, 1, 2, ..., 99, and, hence, our 
entire process will start repeating before long. In fact, our random numbers 
might be 


15, 71, 43, 7, 45, 7, 43, 7, 43,7,... (Cycle of two numbers) 


and, hence, our method is no good. The ideal situation is to generate the 
entire residue class (0, 1, 2, . . . 99,} in a random fashion before starting to 
repeat. It can be proven mathematically that if the numbers M, K, and P 
are chosen according to certain rules, then no matter how we pick the first 
random number r,, the algorithm will generate the entire residue class. So, 
if we pick P very large (like 2*°), we are assured that (for practical purposes) 
the process will never repeat. 

Other numerical methods (such as Simpson's rule) are generally better than 
the Monte Carlo method for evaluating integrals unless we want to evaluate 
a higher dimensional integral like 


1 1 1 1 
r= | | f [e+ >> dx dy dz dw 
0 JO JO JO 


It is possible to generate random samples from various statistical distribu- 
tions other than the uniform distribution f(x) = 1, 0 « x « 1 (the usual 
random-number generator). Computer programs are available to generate 
random samples from the binomial, gamma, normal, and many other dis- 
tributions. These distributions occur in nature and are of interest when it 
comes to modeling the real world. 


PROBLEMS 


1. 


Write a computer program to estimate the integral 


1 
[= [com à 
0 
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How accurate is your answer? Plot the graph of your approximation versus 
the number of random tosses to see if it is converging. 
Generate a sequence of random numbers via the algorithm 

r;,, = Br, + 4)mod 7 ry = 0 


Write a computer program (and flow diagram) to estimate 


1 1 1 
l= | { [ew +»? +2") dy dy dz 
0 JO JO 


What about the accuracy? 
How would you generate a sequence of random points inside the triangle 
T 


— e 


xty=1 


How would you generate a random sample from the statistical distribution 
given in the following diagram: 


1 
4 
0 1 2 


X ? 


In other words, how would you generate a sequence of integers {0, 1, 2} 
where 0 and 2 have probability of .25 and 1 has a probability of .5? 

The Buffon needle problem says that a needle (of length one) tossed ran- 
domly on the American flag (the width of the red and white stripes is also 
one) has a probability of 2/m of crossing one of the lines between the stripes. 
How would you design a game (and computer program) to evaluate m? 


OTHER READING 


Monte Carlo Methods by J. M. Hammersley and D. C. Handscomb. Methuen and Com- 
pany (London), 1964. This concise book outlines the general principles of the Monte 
Carlo method. Solutions of differential equations, eigenvalue problems, and integral 
equations are given in addition to problems in statistical mechanics, neutron diffusion, 
and radiation shielding. The book also contains many additional references. 
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LESSON 43 


Monte Carlo Solution of Partial 
Differential Equations 


PURPOSE OF LESSON: To show how random games (Monte Carlo 


methods) can be designed whose outcomes approximate solutions to dif- 
ferential equations. A specific game (tour du wino) is described whose 


outcome is the finite-difference approximation to a Dirichlet problem inside 
a square. The game is extended to include solutions to other problems as 
well. 


In the previous lesson, we hinted at how games of chance might be designed 
whose expected outcomes were solutions or approximate solutions to problems 
in partial differential equations. This lesson shows how we can design such a 
game to approximate the solution of the Dirichlet problem 


PDE u,+u,=0 O0«x«1 O<y<1 


yy 


= ES On the top of the square 
BE HOO) c qo) = {0 On the sides and bottom of the square 


A = starting point for game e = interior grid points 


(Q = end points Pi gi = reward for ending at p; 


FIGURE 431 Board for tour du wino. 
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(After we show how the Monte Carlo method can solve this particular problem, 
we will then discuss more general problems.) 

To illustrate the Monte Carlo method in this problem, we introduce a game 
called tour du wino. To play it, we need a board on which grid lines are drawn 
(Figure 43.1). | 


Now, for the rules of the game. 


How Tour du Wino is Played 
STEP 1 The wino starts from an arbitrary point (point A in our case). 


STEP 2 At each stage of the game, the wino staggers off randomly to one of 
the four neighboring grid points. (In our case, the neighbors of A are B, C, D, 
and E, and the probability of going to each of these neighbors is .25). 


STEP 3 After arriving at a neighboring point, the wino continues this process 
wandering from point to point until eventually hitting a boundary point p;. He 
then stops, and we record that point p;. This completes one random walk. 


STEP 4 We repeat steps 1-3 until many random walks are completed. We now 
compute the fraction of times the wino had ended up at each of the boundary 
points p;. Table 43.1. shows a typical result after 100 random walks. 


STEP 5 Suppose the wino receives a reward g, (g, is the value of the BC at p,) 
if he ends his walk at the boundary point p,, and suppose the goal of the game 


TABLE 431 Probability of Random Walk Ending at p, 
(along with rewards gj) 


P,(p,) = fraction of times the g, = reward for ending 
Boundary point p, wino ends at p, at p, 


1 1 
2 1 
3 1 
4 0 
5 0 
6 0 
7 0 
8 0 
9 0 
10 0 
11 0 
12 0 
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is to compute his average reward R(A) for all the walks. The average reward 
iS 


R(A) —^giPA(pi)) + 82Pa(p2) ^... B12P (Pir) 


The game is completed with the determination of R(A). In our specific game 
with the values of g, and P,(p,) given in Table 43.1, we have 


R(A) = 1(.04) + 1615) + 1(.03) + 0(.06) +... + 0(.04) 
= 22 


We now tell the reason for playing this game. 


Reason for Playing Tour du Wino 


It turns out that the average reward we just obtained is the approximate solution 
to our Dirichlet problem at point A. This interesting observation is based on 
two facts. 

1. Suppose the wino started at a point A that was on the boundary of the 
square. Each resulting random walk ends immediately at that point, and 
the wino collects the amount g,. Thus, his average reward for starting 
from a boundary point is also g,. 

2. Now suppose the wino starts from an interior point. Then, the average 
reward R(A) is clearly the average of the four average rewards of the 
four neighbors 


R(A) = = [R(B) + R(C) + R(D) + R(E)] 


Again, we ask why the wino’s average reward R(A) approximates the solution 
of the Dirichlet problem at A. We have seen that R(A) satisfies the two equations 


R(A) = 5 [R(B) + R(C) + R(D) + R(E)] (A an interior point) 
R(A) = g; (A a boundary point) 


If we let g, be the value of the boundary function g(x,y) at the boundary point 
Pi, then our two equations are exactly the two equations we arrived at when we 
solved the Dirichlet problem by the finite-difference method. That is, R(A) 
corresponds to u; , in the finite-difference equations 


1 TET ! 
Wu = 4 (uU cis ob EH Ee) (i,j) an interior point 
ui, = 8,,  &,, the solution at a boundary point (i,j) 
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Hence, R(A) will approximate the true solution of the PDE at A. The tour du 
wino game can be summarized in three steps 


Solution of Laplace's Equation by the Monte Carlo Method 


These rules give the solution at one point inside the square. 


STEP 1 Generate several random walks starting at some specific point A and 
ending once you hit a boundary point. Keep track of how many times you hit 
each boundary point. 


STEP 2 After completing the walks, compute the fraction of times you have 
ended at each point p,. Call these fractions P,,(p,). 


STEP 3 Compute the approximate solution u(A) from the formula 
u(A) = g,P4(p1) + 82Pa(P2) + - - - BwPa(Pw) 


where g, is the value of the function at p; and N is the number of boundary 
points. 


The game tour du wino can be modified to solve more complicated problems, 
as in the following example. 


Solution fo a Dirichlet Problem with Variable Coefficients 


Consider the following elliptic boundary-value problem inside a square: 
PDE u,, + (sin x)u,, = 0 0cx«m Ücycm 
BC u(x,y) = g(x,y) On the boundary of the square 
To solve this problem, we replace u,,, u,,, and sin x by 


uy, = [Us i+ = 2U; j uz u; ; lI? 
Uyy = [uiti — 2uj; + uj, Ie (Central-difference approximation) 
sin x — sin x; 


—1,j 


and plug them into the PDE. The grid points can be seen in Figure 43.2. 


Making these substitutions and solving for u,, gives 


uo = “uni + Uj- + SIND si, + Uca) 
S 2(1 + sin x,) 


Look very carefully at this last equation. The coefficients of u,,,,, U,—1,; 
U;,,,, and u,,_, are positive and sum to one. In other words, the solution 
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FIGURE 43.2 Grid points of the random walk. 


u; is a weighted average of the solutions at the four neighboring points. Hence, 
we modify our game so that the wino doesn't stagger off to each neighbor with 
probability .25, but, rather, with a probability equal to the coefficient of the 


respective term. In other words, if the wino is at the point (i,j), he then goes 
to the point: 


1 
TL a 
(i,j + 1) with probability TE cn A Ge any 


1 
ten ! bilit 
(ij — 1) with probability a Ra TN 


— T sin x 
(i + 1,j) with probability TETES C) 


sin x 
| — 1 : ith bilit mr su RAP c 
(i ,J) with probability ir 


Other than this slight modification, the game is exactly the same as before. 
Modifications for other problems may be more subtle, but the ideas are similar. 
The reader may wish to devise his or her own games to solve other problems. 
The parabolic case is considered in the problems. 


NOTES 


1. Observe that once the fractions P,(p;) (the fraction of times the wino ends 
at p,) are computed, we can then find the solution u(A) for any other 
boundary conditions g, just by plugging the P,,(p,) into the formula 

u(A) = g,P4(p,) + g2P4(p2) +... + 8wPa(Pn) 


That is, we don’t have to recompute new random walks. 
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2. In many cases, a researcher wants to find the solution of a PDE at only one 
point. If the boundary is fairly complicated and if the PDE involves three 
or four dimensions, then Monte Carlo methods may come to the rescue. In 
fact, Monte Carlo methods were originally developed to study difficult neu- 
tron-diffusion problems that were impossible to solve analytically. 


PROBLEMS 


1. Write a flow diagram for tour du wino to solve the problem 


PDE u,, + uy = 0 Ücx«1 O<y<l 
BC u(x,y) = g(x,y) On the boundary 


at an interior point. Let the number of horizontal and vertical grid lines be 
arbitrary. 
2. Write a computer program to carry out the flow diagram in problem 1. 
How would the game tour du wino be modified to solve 


iex 


PDE u, +xu,=0 O<x<1l O<y<l 


BC u(x,y) = g(x,y) On the boundary 


What is the nature of the random walk? 
4. Can you devise a modified tour du wino game that will solve 


PDE u,, + Uy, = 0 O<x<l 0<y<1 


u(x,1) = 
BCs u(0,y) = 1 

ou 

—(í(1 = 0 


5. Derive the Monte Carlo game for solving the following parabolic IBVP: 


PDE Uu, = a*u,, — Bu, — yu 0cx«1 0O<t<e« 
u(0,t) = f(t) 
BCs EM = g(i) O0<t<x 
IC u(x,0) = (x) 0xxxl 


HINT Replace the PDE by the finite-difference approximation from the Crank- 
Nicolson method; solve for u;,,, in terms of its five neighbors uj,,;.,, 
Uisig+is Ui jsp, Uj, Uij+1, and go on from there. 
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OTHER READING 


"Monte Carlo Methods" by G. W. Brown from E. F. Beckenbach, ed., Modern Math- 
ematics for the Engineer. McGraw-Hill, 1956. A short chapter illustrating the basic ideas 
of the Monte Carlo method. 
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LESSON 44 


Calculus of Variations (Euler- 
Lagrange Equations) 


PURPOSE OF LESSON: To introduce the idea of a functional (func- 


tion of a function) and explain how functionals arise naturally in physics. 
A very common type of functional is the integral 


JD] = l F(x,y,y') dx 


where the functional J is considered a function of y (a function), and the 
integrand F(x, y, y') is assumed known. An example is the functional 


Hy] = | DE)  y?09] ds 


We will also show how to find the function y(x) that minimizes J[y] by 
finding an equation (Euler-Lagrange equation) in y that must always be 
true when y is a minimizing function. This equation is similar to the nec- 
essary condition in calculus that states 


df(x) _ 
wee 


at those points x minimizing the function f(x). 


One topic that is closely related to differential equations, but which, unfortu- 
nately, many students do not study, is calculus of variations. This lesson, along 
with the next, introduces the subject and shows how PDEs can be solved by 
variational principles. 

Calculus of variations was originally studied about the same time as calculus 
and deals with maximizing and minimizing functions of functions (called func- 
tionals) .One of the first problems in calculus of variations was the Brachistochrone 
problem proposed by John Bernoulli in 1696, which attempts to find the path 
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y(x) that minimizes the sliding time of a particle along a frictionless path between 
two points (Figure 44.1). 


y 


= minimum time path between two points 


Gravity 


FIGURE 441 Brachistocrone problem (original problem in calculus of 
variations). 


Bernoulli showed that the sliding time T could be written 


ral ae Za sf. | £- c [= + y”? 


and, hence, the total time 7[y] can be thought of as a function of a function. 
Since many functionals in nature are of this type, it will suffice for us to study 
the general form 


(44.1) J[y] = [ Fey) dx 


With this motivation in mind, we now state our goal in this lesson: to find 
functions y(x) that minimize (or maximize) functionals of the form (44.1). The 
strategy for this task is somewhat the same as for minimizing functions f(x) in 
calculus. There, we found the critical points of a function by setting f'(x) = 
and solving for x. In calculus of variations, things are much more subtle, since 
our argument is not a number, but, in fact, a function itself. However, the 
general philosophy is the same. We take a functional derivative (so to speak) 
with respect to the function y(x) and set this to zero. This new equation is 
analogous to the equation 


dfx) _ 
dx 
from calculus, but now it is an ordinary differential equation, known as the 
Euler-Lagrange equation. The remainder of this lesson is devoted to finding this 
equation and solving it for specific problems. 
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b 
Minimizing the General Functional J[y] = | F(x,y, y) dx 


We consider the problem of finding the function y(x) that minimizes the func- 
tional 


Jb] = | F(x,y,y') dx 


from among a class of smooth functions satisfying the boundary conditions 


See Figure 44.2. 


J. 


yix) = minimizing function (b, B) 


N 


yix) + en(x) = variation from y 


Se — ce — — Á — — es ee ee X ee ee ee — 


a 


FIGURE 44.2 The variation of a function. 


To find the minimizing function, call it y, we introduce a small variation from 
y(x); namely, 


yx) + en(x) 


where e is a small number and n(x) is a smooth curve satisfying the BC n(a) 
= 7(b) = 0; they are shown in Figure 44.2. It should be clear that if we evaluate 
the integral J at a neighboring function y + en, then the functional J will be 
greater; that is, 


Jy] s Jy + en] 


for all e. In other words, if we graph the function ó(e) = J[y + en] as a function 
of e, we will have a graph something like Figure 44.3. 
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dle) = JLy + en] 


FIGURE 44.3 Graph of J[y + en] in a neighborhood of e = 0. 


With Figure 44.3 in mind, our strategy for finding y is to take the derivative of 


(e) = J[y + en] 
with respect to e, evaluate it at € = 0, and set this equal to zero; that is, 


dé) d |. 
de a PM 


£g —0 
^ | OF oF 
= — tn 


(The reader should carry out this step.) From integration by parts, we have 


-Í E -4 HES dx = 0 


Now, since this integral is zero for any function n(x) satisfying the boundary 
conditions n(a) = (b) = 0, it is fairly obvious that the remaining portion of 
the integrand must be zero; that is, 


(44.2) — — — H = 0 (Euler-Lagrange equation) 


Equation (44.2) is known as the Euler-Lagrange equation, and although it may 
look complicated in its general form, once we substitute in specific functions 
F(x,y,y'), we will see immediately that it is just a second-order, ordinary dif- 
ferential equation in the dependent variable y. In other words, we can solve this 
equation for the minimizing function y. 
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So, what we have shown is that (we drop the notation y and just call it y) 


b 
If y minimizes J[y] = | F(x,y,y’) dx, then y must satisfy the equation 


Fa [sr]. 
oy ax | oy’ 


In order to clarify these ideas, we present an example. 


1 
Finding the Minimum of the Functional J[y] = | [y2 + y'?] ax 


Here, we will attempt to find the function y(x) that passes through the points 
(0,0) and (1,1) and minimizes 


yl = | b+ yar 


It is clear from the context of our problem that we are referring to a function 
that is differentiable inasmuch as the integrand depends on y’. To find y, we 
start by writing the Euler-Lagrange equation [with BCs y(0) = 0 and y(1) = 1] 


d 
F, — dx P» = 0 
y(0) = 0 
y(1) = 1 


Since F(x,y,y') = y? + y", we have 


, = 2y' 


y 


(Just differentiate F with respect to y and y’) 


y 


and, hence, the Euler-Lagrange equation is 
d 
2y — — (2y’) = 0 
y — & Q) 
or just 


~y=0 
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Solving this simple differential equation with BCs y(0) = 0 and y(1) = 1 gives 
y(x) = 0.42e* — 0.42e* 


which is shown in Figure 44.4. The claim here is that any other smooth curve 
y(x) passing through the two boundary points will give rise to a larger J[y]. 


Admissible curves 


yix) = 0.42e* - 0.42e* 
- minimizing function 


x 
0 1 


FIGURE 44.4 All possible smooth curves satisfying the BC y(0) = 0 and 
y) = 1. 


NOTES 


1. The Euler-Lagrange equation is analogous to setting the derivative equal 
to zero in the calculus. If the reader remembers, we don’t always find the 
minimum (or maximum, for that matter) by this process. For example, the 
function f(x) = x? has zero derivative at x = 0, but this point is neither a 
local maximum nor minimum; the same holds true with the Euler-Lagrange 
equation. We should think of it as a necessary condition that must be true 
for minimizing functions but may be true for other functions as well. Quite 
often, however, the solution of the Euler-Lagrange equation will be a local 
(in fact, global) minimum by the very nature of the problem; we can often 
tell if this is the case. 

2. The minimum y(x) of the functional 


b 
Jly] = | yV1 + y" dx 


is the curve that gives rise to the minimum surface area of revolution when 
we rotate y(x) about the x-axis (Figure 44.5). 


The solution of the Euler-Lagrange equation with BCs y(a) = A and y(b) 
= B is part of the hyperbolic-cosine curve (catenary) 


y(x) = a cosh [(x — B)/a] 
where the constants a and B are determined so that the curve passes through 
the end points. This is a fairly difficult equation to solve, although the reader 


could verify that the hyperbolic cosine does satisfy the equation. 
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y = minimizing function 


Surface of revolution 
(Soap film between 
two circular hoops) 


FIGURE 44.5 Minimum surface of revolution. 


3. We could evaluate the functional 


1 
ID] = [ b «4 
that was minimized in this lesson for the minimization function 
y(x) = 0.42& —0.42e^* 


to see that J[y] = 0.46. If we substitute any other smooth function y(x) 
passing through the end points (0,0) and (1,1), we get a larger value of J[y]. 

4. Basic principles of physics are often stated in terms of minimizing principles 
rather than differential equations. Fermat's principle (a light ray requires 
less time along its actual path than along any other path having the same 
end points), Hamilton’s principle (in a conservative force field, a particle 
moves so as to minimize the action integral 


| (kinetic energy — potential energy) dt 


are examples of nature behaving in such a way that minimizes functionals. 
5. Calculus of variations ideas can also be used to minimize important multiple- 
integral functionals like 


J[u] = [| F(x,y,u,u,,u,) dx dy 
where the corresponding Euler-Lagrange equation is 


0 ð 
Fe a ee (A PDE) 
ox " oy ” 


In fact, these functionals are the ones that we will be concerned with in the 
next lesson, since the Euler-Lagrange equation is a PDE. Our general phi- 
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losophy, however, will be slightly different, since our goal is to find the 
function u(x, y) (by some new technique) that minimizes this double-integral 
functional and, hence, is a solution to the PDE. In other words, we solve 
the PDE by minimizing the functional. This is in contrast to what we have 
been doing in this lesson with single-integral functionals, where we have 
been finding the minimizing function by solving the Euler-Lagrange equa- 
tions. Methods for solving differential equations by finding the minimizing 
function of their corresponding functional J[u] are called direct methods in 
the calculus of variations. Methods for finding minimizing functions of func- 
tionals J[u] by solving their corresponding Euler-Lagrange equation are 
called indirect methods in the calculus of variations. The next lesson discusses 
the well-known direct method of Ritz. 


PROBLEMS 


1. Find the minimizing function y(x) of 
: m —— — Me 
J[y] = | V1 + y" dx 


among those curves satisfying y(0) = 0 and y (1) = 1. What is your inter- 
pretation of your answer? What is the value of J[y]? What is the meaning 
of J[y]? 

2. The kinetic energy of a simple vibrating mass is given by KE = 


> m y? where y = dyldt, and its potential energy is given by PE = : ky?. 


k 
y(t) 
Vibrating mass at the end 
of a spring 


Hamilton’s principle states that the motion y(t) of the mass is such that the 
integral 


| [KE — PE] dt = Ji [my? — ky?] dt 


is minimized. If this law is valid, what differential equation must the vibrating 
mass satisfy? 
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3. Show that the minimizing function y(x) for the functional 


T/2 
I= | b*-»yl& 
with BCs y(0) = 0 and y(m/2) = 1 is y(x) = sin x. Evaluate J(sin x). 
4. Derive the Euler-Lagrange equation 


Pd dp = 0 
ox " oy ” 


from the functional 


J[u] = | | Fley,uunus,) dx dy 


OTHER READING 


Methods of Mathematical Physics by R. Courant and D. Hilbert. Interscience Publishers, 
1953. A classic text with many examples; see Chapters 4-6. 
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LESSON 45 


Variational Methods for Solving 
PDEs (Method of Ritz) 


PURPOSE OF LESSON: To show how differential equations can be 


solved by interpreting the equation as the Euler-Lagrange equation of 
some functional and then finding the minimizing function of the functional 
(by some new method). The minimizing function will then be the solution 
of the PDE. The problem, of course, is to find the functional that has the 
original equation as its Euler-Lagrange equation. A well-known result 
(minimum-energy theorem) is presented that says finding the solution u to 
certain elliptic BVPs like 


Us t y, =f Ina region D 
u 


= 0 On the boundary of D 


is equivalent to finding the function u (also zero on the boundary of D) that 
minimizes the potential-energy functional 


J(u] = L [uz + u? + 2uf] dx dy 


Thatis, V?u = fis the Euler-Lagrange equation ofJ[u]. An approximate min- 
imizing function of J[u] is found by the Method of Ritz, and so we have the 
solution (an approximation) to the PDE. The method of Ritz will be discussed 
and a functional minimized using this technique. 


There is a very nice way to solve boundary-value problems (like the stretched- 
membrane problem) by looking for the smooth surface that minimizes the po- 
tential energy of the membrane. That is, if we think of our PDE as being the 
Euler-Lagrange equation of some functional J[u], then we can solve the differ- 
ential equation by minimizing the functional (since the minimizing function of 
the functional is also the solution of the corresponding Euler-Lagrange equa- 
tion). In Lesson 44, we only considered functionals where the Euler-Lagrange 
equation was an ODE. This lesson considers functionals where the Euler-La- 
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grange equation is a PDE. for example, the functional 


J[u] = Í Í [uz + us] dx dy 


has as its Euler-Lagrange equation (proof similar to the ODE case in the last 
lesson) 


and so to solve the Dirichlet problem in the unit square 


PDE u 
BC u =g On the boundary of the square 


+u, = 0 0cx«1 0<y<1 


we can alternatively find the function u(x,y) that is equal to g on the boundary 
and minimizes J[u]. It probably comes as no surprise that the functional 


J[u] = MI [u2 + u?) dx dy 


represents the potential energy of the membrane, and so what we are, in fact, 
doing is finding the minimum potential-energy surface. The question, of course, 
is, given a differential equation, how do we find the functional J[u] that represents 
the potential energy of the solution? The answer to this question is given in a 
well-known theorem (minimum-energy theorem) that states: 


The solution u of the Dirichlet problem 


PDE V?u =f Ina region D 
BC = 0 On the boundary of D 


is the same function u that minimizes (among those functions having BC u = 
0) the energy functional 


J[u] = IN [uz + u? + 2uf] dx dy 


This theorem is stated for other types of BCs and is proven in the reference of 
Other Reading. To help understand the theorem, we present an example. 


Variational Methods for Solving PDEs (Method of Ritz) 363 


Replacing Poisson's Equation by Its Potential-Energy 
Functional 


Consider the Dirichlet problem 


(45.1) PDE Uu + Uy, =f 0<x< 1 O<y<l 


BC u=0 On the boundary of the square 
See Figure 45.1. 


FIGURE 454 Poisson's equation inside a square. 


Here, the energy functional J[u] is 


(45.2) J[u] = NET + u? + 2uf] dx dy 


and so to solve problem (45.1), it is sufficient to find the function u (among 
those that are zero on the boundary) that minimizes J[u]. 

This completes the first part of the lesson. For the remaining part, we show 
how to find the minimizing function zu of J[u] using the method of Ritz. 
Method of Ritz for Minimizing Functionals 
This method is only one of several discussed in the reference of Other Reading. 
The idea was introduced by the mathematician W. Ritz and is quite simple; it 


consists of the following steps: 


STEP 1 Replace the function u in the functional 


lel 
J[u] = I1 [uz + u? + 2uf] dx dy 
by an approximating function (the user picks n) 
u(x, y) = ab(x,y) + apx, y) + c + a,b.) 
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where the functions 6,, 65, 64, . . . , o, are chosen in advance so that they are 
all zero on the boundary and represent a nice enough class, so that they can 
reasonably approximate the solution to the problem. Typical choices for the 
Dirichlet problem inside the unit square would be: 


d(x,y) = xy(1 — xY1 - y) < Zero on the boundary 
(x,y) = xo x,y) 
p(x, y) = yọ (xy) 
oix, y) = x’, (x,y) 
bs(x,y) = xyd,(x,y) 
b6(%y) = yp (x,y) 


In other words, the first four approximations to the solution are: 
u(xy) = axy(1 — x)ü - y) 
u,(x,y) = xy(1 — x) — y)[a, + ax] 


u(x,y) = xy(1 — x) — y)[a, + a,x + ax] 
ux,y) = xy — x) — y)[a, + ax + asy + a,x’°] 


STEP 2 The functional 


1 fl n 2 n ð l 2 n 
J[u,] = NI {| Sa a + b 5] t Aud | ds d 


is now a function of a,,a,,... , a, and so to find these coefficients that minimize 
J, we set the following partial derivatives equal to zero: 
àJ[u "fa | ab, a db, à 
lud | 3$, 0b, , 9b; 9, a; + fo, dx dy = 0 
0d, 0 Jo Ox Ox dy oy 


au] ab; 86, | ab; ab, | E 
affi E ax + 9695 ue go, | de ay = 0 


Variational Methods for Solving PDEs (Method of Ritz) 365 


This all looks pretty complicated, but if we rewrite these two equations in matrix 
form, we have the system of linear equations 


Aa =b 
where 


A = (Aj) is the n x n matrix with elements (can be computed) 


dh; Io, nu do 
oo Ae ff [o2 ju 


= (b,) is the vector with components 


I çl 
(45.4) b= -| [ fone dx dy 
and 
a = (aj) is the unknown vector whose elements represent the coefficients 
in the approximate solution u,(x,y) = a,6,(x,y) + ... + a,ó, (xy). 
STEP 3 Solve the linear system Aa = b for the coefficients ili; We ae acu 


Hence, we have the approximate minimizing function 
u(x,y) = ayb,(x,y) + abx, y) +... + a,b, (x,y) 


and, hence, an approximation to the solution of Dirichlet problem (47.1). 


NOTES 


1. The Ritz method was used to minimize double-integral-type functionals in 
this lesson. It could also be used to minimize functionals like 


Jp] = | [^ + y] dx 
y0) =0 yd) = 


The only difference here would be that approximation by functions 9,, p», 


o;,..., $, in y(x) = ajo, + ab, +... + a,b, would have to satisfy 
the BCs 

$,(0) = " 

ds i = 1,2, ,n 
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2. 


OO 


It wasn’t proven in this lesson that the Euler-Lagrange equation of the 
double integral 


J[u] = NM [uz + wu] dx dy 


is Laplace's equation, but the proof is analogous to the arguments in Lesson 
44 in the single-integral case. 


In the reference of the recommended reading, we show how to construct 
the energy functional J({u| for many other differential equations (other than 
Poisscn's equation) and for many other kinds of BCs (other than Dirichlet 
type u = 0). Hence, many kinds of BVPs can be solved by minimizing the 
corresponding energy functional. 


The larger we pick n, the smaller the actual value of J[u,], and, hence, the 
more accurate the solution to the differential equation. One strategy would 
be to compute u,,(x,y) for larger and larger values of n and see how much 
J[u,] is decreasing. 


For all practical purposes, computations in the Ritz method would have to 
be carried out on a computer unless n was very small. The flow diagram in 
Figure 45.2 illustrates the computations we would make in order to solve 
BVP (45.1) by the Ritz method. 


The user would have to provide a subroutine to define the functions ,, Qz, 
..., 6, and evaluate them. This could be done in a subroutine like the 
following: 


SUBROUTINE BC (X, Y. PHI) 


SUBROUTINE PROVIDED BY THE USER TO EVALUATE THE 
FUNCTIONS PHI(1),PHI(2), . .., PHI(N) 


DIMENSION PHI(20) 

PHI(1) = X*Y*(1— X)*(1 — Y) 

PHI(2) = X*PHI(1) (these are the functions we’ve been using) 
PHI(3) = Y*PHI(1) 


PHI(N) = (whatever it is) 
RETURN 
END 
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Read n = the number of terms inu, (x. y} (Between five and ten would be 
a good choice) 


Compute — A(I, J) and B(I) from formulas (45.3) and (45.4). The integrals will 
probably have to be computed numerically, and the boundary condi- 
tion f(x, y) could be evaluated in a subroutine. The partial derivatives 
could be evaluated directly for those cases where the functions $; are 
polynomials but could be evaluated by approximate finite-difference 
formulas. 


Solve the system of linear equations Aa = b for a = (a;) (we could use an 
existing subroutine from the computer center). 


We're done The answer (approximation) is 
upx, y) =a,6, * 4205 t- -+a 0,. We could evaluate the 
functional J[u,] (numerically) at this time. If we wanted to 
evaluate zu, (x, y) at some point (x, y), we could write a small 
program to do so. It may be true, too, that we could go back 
to the beginning of the program and change n. 


FIGURE 45.2 Flow diagram for the Ritz method. 


PROBLEMS 


1. What would be the energy functional J[u] corresponding to the following 
problem: 


PDE HU, tu, =1  0-«x«1 0<y<1 
BC u=0 On the boundary 
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2. How could we minimize the functional 


Jly] = | D^ t+ y?]dx = y0)=0 yl) =1 


by the method of Ritz? 
HINT If we introduce a new function z(t) 


z(t) = (1 — x)y(t) 


we note that z(t) satisfies z(0) = 0 and z(1) = 0. 


ed 


Write a computer program to carry out the computation in Figure 45.2. 
4. Show that the Euler-Lagrange equation of the functional J[u] 


1 1 
J[u] = | [ [uz + u?) dx dy 


5. The Dirichlet problem 


Uu, + U,, = sin (mx) 0<x<1 0<y<1 
u= 0 On the boundary of the square 


can be solved by the finite sine transform (transform the x-variable) and has 
the solution 


1 
u(x,y) = |Ae" + Be — a sin (mx) 


where A = 0.06 and B = 0.04. How would we find the potential energy 
of the solution? It would be a good review for the reader to use the sine 
transform and find this solution u(x,y). 


OTHER READING 


Variational Methods in Mathematical Physics by S. G. Miklin. Macmillan, 1964. This 
book discusses many types of methods for minimizing functionals and how these results 
can be applied to solving PDEs. In addition to the Ritz Method, the well-known method 
of Galerkin is discussed; see Chapters 3-4. 
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LESSON 46 


Perturbation Methods for Solving 
PDEs 


PURPOSE OF LESSON: To show how different problems (nonlinear, 


equations with variable coefficients, irregular domains) can be solved by 
perturbing easier problems. In other words, to show how the solutions to 
easy problems can be modified so that they approximate solutions to hard 
problems. 

For example, we will show how the solution to the nonlinear problem 


PDE V^u + w = 0 O<r<]l 
BC u(1,6) = cos 0 0<6@52n 


can be approximated by perturbing the solution u(r,0) = r cos 9 to the linear 
Dirichlet problem 


PDE Vu = 0 0<r<1 


BC u(1,0) = cos 0 0zx60zx2mT 


Quite often a problem whose solution is known can be continuously changed so 
that nearby problems can be solved by a gradual modification of the solution 
of the first one. That is, we continuously modify (perturb) the original problem 
(and its solution) in a gradual way so that nearby problems are solved. 
For example, Laplace's equation 
V*u = 0 
can be continuously modified via the family of problems 
V?u + e? =0 O0xexl 


so that we arrive at the new nonlinear equation 


Vu + uz = 0 
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In this way, we can attempt to solve nonlinear problems by modifying the solution 
to Laplace's equation (Figure 46.1). 


V?u = 0 — Vu + ew? = 0) — Vu + vv? = 0 
(e = 0) (0 « e « 1) (e = 1) 


Solution Solution Solution 


u = > e*u, — u= > u, 
k=0 k=0 


Uy 


FIGURE 461 Schematic diagram of perturbation methods. 


In seeking the solution to the perturbed Laplace equations 
V?^u + ev? = 0 


we modify the solution u, of Laplace’s equation by adding on small perturbations. 
It seems reasonable that the perturbed equation 


V2u + ew = 0 
should have a solution of the form 
(46.1) U =U, + eu, + eu, +... 


Note that power series (46.1) in e agrees with Laplace's solution u = uo when, 
€ = 0 and will be the solution of the nonlinear problem (if it converges) 


Vu + w= 0 
when s = 1. In other words, equation (46.1) acts as a vehicle that allows us to 
go from Laplace's equation to the nonlinear one. The problem is to find the 
functions Up, U, Uz, .. . in power series (46.1). For the remaining part of this 


lesson, we will show how different boundary-value problems can be solved by 
this general principle. 


A Perturbation Solution of the Nonlinear Equation 
Vuruw-0 


Suppose we would like to solve the following nonlinear Dirichlet problem 


(46.2) PDE Vu +u = 0 0O<r<]l 
BC u(1,9) = cos 0 0<02t 
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The idea here is to think of this nonlinear problem as a perturbation of the linear 
one 


(46.3) PDE Vu = 0 0crc«1 

BC u(1,0) = cos 0 0zx60zx2mT 
which has the solution uj(r,8) = r cos 6 and ask how to modify u,(r,8), so that 
it satisfies problem (46.2)? As we mentioned earlier, we introduce a class of 


problems V?u + eu? = 0 and look for solutions of each of these equations of 
the form 


(46.4) u(r,9) = us(r,9) + eu,(r,9) + €uro) +... 


In this way, we find the solution of our nonlinear problem (46.2) by letting e€ 
— ]. Substituting our perturbed candidate (46.4) in the perturbed problem 
PDE V?^u + eu? = 0 
BC u(1,6) = cos 0 


we get 


V?(ug + eu, + e?u, +...) + efluo + Eu, + eu, +...) = 0 
u,(1,6) + eu,(1,6) + €7u,(1,6) +... = cos 0 


Performing a little algebra and setting the coefficients of the powers of e equal 
to each other, we arrive at the following sequence of problems P, P, Pa ... 
from which we can solve for our unknown functions uo u, . . . (note that the 
problem are linear and nonhomogeneous): 


V4u=0 OK<r<il B 
P; Mn Z oun uo(r,8) = r cos 0 
V?^u, = — u$ 
o Ma" = 0 
P V?^u, = — 2u; 
2 u,(1,6) = 0 


372 Numerical and Approximate Methods 


Let's start by finding u,(r,0) from problem P, (we already know uo); we have 


2 2 
- —- — Ccos (20) 


r? 
P, hn = — r cos 0 = — 7 [1 + cos (20)] = 373 


u,(1,0) = 0 


To solve this nonhomogeneous problem, we resort to a technique that the reader 
may recall from ODE theory and that consists of the following: 

1. Finding the general solution y, of the homogeneous equation 

2. Finding a particular solution y, of the nonhomogeneous equation 

3. Substituting y, + y, into the IC and solving for the constants 
This technique will work for this specific problem. In our problem P,, the general 
form of the homogeneous solution of V, = 0, 0 < r < 1 is chosen as the 
separation of variables solution 


oc 


u,(r,0) = >, r'[a, cos (n0) + b, sin (n6)] 


n=0 


Now, to find a particular solution (just one solution) of the nonhomogeneous 
equation 


r? r? 
2 dup. t a UN ee 
Vu z 7 5008 (20) 


we try 
u,(r,0) = Ar^ + Br* cos (20) 
[Inputs of r^, r” cos (n9), r” sin (n9) give rise to solutions of the form Ar"**, 


Br"*? cos (n0), Cr"*? sin (n0), respectively]. Substituting u,(r,0) in the non- 
homogeneous equation gives 


Thus, we have 


py n 
u,(r,0) = 73 75495 (20) 


Our final step in solving P, is to substitute the general solution u(r,9) = 


u,(7,6) + u,(r,9) in the BC u(1,9) = 0 and solve for the coefficients a, and b,. 
Doing this, we get j 


= 1 1 
+ ET 01 z 
2 [a, cos (n0) + b, sin (n6)] 3 5499 (20) = 0 
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and, hence, a, = 1/32, a, = 1/24, and all the other a's and b’s are zero. In other 
words, the solution of problem P, is 
1 1 Ld 


4 
u,(r,0) = 32 + 24 r? cos (20) — 54 COS (20) — s 


_ a se) 
= 32 34 008 (20) 
The function u,(r,8) is called the first perturbation of u,(r,@) and by adding it 
to u,(r,8), we have the new approximation 


Gey) Can 


(46.5) U =U, + U, = r cos ô — 32 24 


cos (20) 


to problem (46.2). To find the next perturbation u;(r,0), we must solve 


P V?u, = — 2u, 
á u,(1,6) = 0 


where uj(r,0) and u,(r,9) are substituted in the right-hand side of this equation. 
Needless to say, without the help of a computer to carry out these algebraic 
manipulations, this would be a significant problem in itself. Fortunately, equation 
(46.5) is a fairly accurate solution to our problem. In fact, if we substituted this 
approximation in the left-hand side of our nonlinear equation 


V2u + u? 


we could see that it is almost zero everywhere inside the circle 0 < r < 1. 

In addition to solving nonlinear equations, perturbation theory can also be 
applied to solving problems with irregular boundaries (as long as they're not too 
irregular); we now present a simple example. 


An Example of a Boundary Perturbation 


PDEs aren't the only things that can be perturbed. We can find the solution of 
Laplace's equation inside a deformed circle by perturbing the solution of La- 
place's equation inside a circle. For example, suppose we want to find the 


potential inside the region r = 1 + q Sin 6 with the potential u given on this 


boundary. In other words, solve 


1 
Vu = -0 0O<r<l1+-si 
(46.6) u r sin 0 
(1 + Lino, 6) = cose 0zx602zx2m 
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d Y 
= + — 
r= 1 z sing 


FIGURE 46.2 Laplace's equation inside a deformed circle. 


See Figure 46.2. We could think of this problem as describing a soap film inside 
a deformed circle where the height of the wire is cos 0. 

Since the general philosophy of perturbation procedures is to rewrite a difficult 
problem in terms of an easy one, we think of the BC on the deformed circle 


(a F : sin 0) = cos 0 
as just the extreme BC in the family of BCs 


u(1 + e sin 0, 0) = cos 0 O<ex 


See Figure 46.3. This idea leads us to think in terms of Taylor’s series. Using 
a Taylor series like 


f(x + h) = f(x) + f'(x)h + re) = T... 


BC onr=1+esin@ 
0 « e « 1/4 


BC onr= 1 + sin 0 
(Hard BC) 

(Family of BCs linking the 

simple and hard BCs) 


BC on the circle r = 1 
(Simple BC) 


FIGURE 46.3 Schematic illustration of perturbation procedures. 


Perturbation Methods for Solving PDEs 375 


we can expand the hard BC in terms of the easy one; that is, 


u(1 + e sin 6,9) = u(1,0) + (1,9) (c sin 0) + v, (1,0) emo, sino) 


Substituting this in our original problem gives us the new equivalent problem 
(we will, of course, let e = 1/4 when we get done) 


V?u = 0 0«crc«l1-sesinO 


(46.7) 


(e sin n 


u(1,6)  &,(1,9) (e sin 0) + u, (1,0) . = cos 0 


This, of course, doesn't look like an easy problem either, but we can now divide 
the problem into a sequence of problems where we can separately find the 
functions Uo U, U .. . in the desired solution 


(46.8) U = ug + eu, + €u, +... 


If we substitute this series into problem (46.7), we get the following sequence 
of problems from which we can find up, u, .. . 

V?u = 0 0<r<1 (Inside a circle) _ 

P, beer =: edd uo(r,9) = r cos 0 


Vu 2-0 O0-crc«1 (Inside a circle) 


P, 
— sin 0 3u(1,0) 
or 


u,(1,0) = — sin 0 cos 0 


Hence, we can solve each of these Dirichlet problems (inside the circle) for uo, 
u, u, .. . and so obtain the solution 


1 Y 
Ho cU CY WES dle 


(note that we have let € = 1/4) of the Dirichlet problem in the deformed region. 
The reader will get a chance to find the first perturbation u, and check the 
approximation 


1 
ug + — 


4^ 
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to see how well it satisfies equation (46.6). 


NOTES 
Nonlinear problems are not the only types of PDE problems that can be solved 
by perturbation processes. We could solve the initial-value problem 


u, = (1 + x)u,, 


(46.10) u(x,0) E (x) —-m~< x « oo 
by introducing the parameterized equation 
(46.11) u, = (1 + ex)u,, 


and look for a solution of the form 
U = Ug + eu, + e'u +... 


Substituting this expression in problem (46.11) gives us the following sequence 
of problems: 


La a Lli 

üt — x 
P, 

uo(x,0) = (x) 

du, 8u, 07Uy 

a a8 ax? 
P, 

u,(x,0) = 0 


Note that the two displayed problems have constant coefficients. The reader 
should be aware that e in the perturbation equation must be small or else the 
infinite series will not converge. 


PROBLEMS 


NR a De DENEN GNU ONE RE Ve V] 


1. Substitute equation (46.8) in problem (46.7) to find the sequence of problems 
Dodd es 
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2. Show that the nonlinear problem 


Vu +u =Q 0<r<1 
u(1,6) = cos 0 


gives rise to the sequence of linear problems P, P, Pa . . . as shown in the 
lesson. 
3. Substitute equation (46.5) in the nonlinear problem 


to check its accuracy. 
4. Solve problem P, in the boundary-perturbation problem and check how well 
u(r,9) = uj(r,8) + 7 u,(r,9) satisfies 


V?u = 0 
1 
u(1 + z sin 0,0) = cos 0 


OTHER READING 


Partial Differential Equations: Theory and Technique by G. F. Carrier and C. E. Pearson. 
Academic Press, 1976. Chapters 8 and 15 will give the reader a good idea of many of the 
facets of perturbation theory; an excellent reference text. 
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LESSON 47 


Conformal-Mapping Solutions of 
PDEs 


PURPOSE OF LESSON: To show how certain boundary-value prob- 
lems in two dimensions can be transformed into new ones by means of a 
conformal change of variables. For example, we can solve Laplace's equa- 
tion 


Da + dy = 0 


inside a complicated domain of the xy-plane (with some type of BC) by 
transforming the problem into a new Laplace equation 


bu + 6, = 0 


inside a simple domain of a new uv-plane. 


Complicated 
domain 


bax tyy = 0 


Conformal 
mapping 
— 


Simple 
domain 


bun + Py = 0 


New BC 


If the mapping is conformal, then Laplace’s equation $,, + ,, = Qin the 
original coordinates (x,y) will be transformed into Laplace's equation 6,, 
+ ,, = 0 in the new (u,v) coordinates (instead of some other equation, 
like o,,, + 26,, + ,, = 0). We can then solve this Laplace equation for 
(u,v) in the simple domain (like a circle, half plane, square) and substitute 
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our transformation u = u(x,y), v = v(x,y) in this solution to obtain our 
solution ó[u(x, y), v(x, y)] in terms of the original x,y coordinates. 

This lesson will show the reader: 

]. The nature of conformal mappings 

2. How to construct them (to a certain extent) 

3. Examples of problems solved using this technique 


One of the major difficulties in solving boundary-value problems is due to com- 
plicated boundaries; even relatively simple boundaries can often cause a problem 
to be very difficult. One way, of course, to attack irregular boundaries is by 
means of perturbation methods, but this generally works only if the boundary 
is close to a simple boundary. 

There is a way, however, to solve Laplace's equation in two dimensions when 
the boundary is fairly general, and that is by applying conformal mappings. 

However, before we get into the actual application of this technique, we must 
spend a little time talking about the concept of a conformal mapping and about 
complex numbers in general. 


Conformal Mappings and Complex Functions 


This lesson presents only a few ideas from complex variables that will be needed 
later. We can imagine a complex number z — x - iy as a point in a complex 
xy-plane (Figure 47.1). 


y (Complex axis) 


Isl=r= yx? +y? 
z=x +y A 
= +18 
= re! arg(z) = arctan y/x 


Complex 
z-plane 


x (Real axis) 


FIGURE 47.1 Complex z-plane and useful formulas. 


In order to introduce the idea of a conformal mapping, we must introduce the 
idea of a function of a complex variable 


w = f(z) 
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Here, z is a complex variable (that has some domain in the complex z-plane), 
and w = u + iv is a new complex variable [that will run around according to 
the formula f(z) in a new complex w-plane]. For example, the complex function 
w = 2? defined in the first quadrant of the complex z-plane will map this domain 
onto the entire upper half v > 0 of the complex w-plane. In particular, w = z? 
will send the following points of the z-plane onto the corresponding points of 
the w-plane: 


TABLE 47.2 


z-plane zz w-plane 


0 ————————— 0 
i ———_—_—_— - 1 
1+ i|—————————2i 
x-axis ————— Positive real axis 
First quadrant ———» Upper-half plane 


See Figure 47.2. 


y v 
2 
2 
3 4 
4 
x u 
1 3 1 


FIGURE 47.2 Mapping the first quadrant of the z-plane onto the upper 
w-plane. 


In other words, when we talk about functions of a complex variable w = f(z) 
(in contrast to functions of a real variable, which the reader is already familiar 
with), we discuss how curves in the z-plane map onto curves in the w-plane. 
Before going on, the reader should know how complex mappings like w = z? 
can be written in an equivalent real form. The real form tells us how the original 
coordinates (x,y) in the z-plane map onto the new coordinates (u,v) in the w- 
plane. To find the real form of the mapping, we merely write w = z? as 


u + iv = (x + ly)? = x? — y? + 2ixy 


and, hence, setting the real parts equal to the real parts and the imaginary parts 
equal to the imaginary parts, we have 


u = x? -y 


mn 
peo (Real form of w = z?) 
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This form wil be useful later. In this particular case, this form is interesting 
because it says that hyperbolas in the z-plane map onto the coordinate lines u 
— constant, v — constant, in the complex w-plane. 

We now get to the special kind of functions, functions of a complex variable 
known as conformal functions (or conformal mappings). 


e 
* 


Definition of a Conformal Mapping 


We say that a mapping w = f(z) between the complex z- and w-planes is 
conformal at a point z, in the z-plane if the derivative f'(z,) + 0. What's more, 
we say that f(z) is conformal everywhere in a region D of the z-plane if f'(z) 
+ 0 everywhere in D. 

For example, f(z) = z? is conformal everywhere except at z = 0, since f'(z) 
=2z + 0 for all z # 0. On the other hand, e7 is conformal everywhere in the 
z-plane, since f'(z) = e + 0 everywhere. The question, of course, is why 
conformal mappings are useful? The answer is that in solving Laplace’s equation 
$,, + ,, = 0 inside some domain of the xy-plane, we can think of the xy-plane 
as the complex z-plane and introduce a complex mapping w = f(z) from the z- 
plane to a new w-plane. The w-plane has coordinates (u,v), and so the original 
Laplace equation ,, + ó,, = 0 will be transformed into a new PDE in coor- 
dinates u and v. The point is that if the mapping w = f(z) is conformal everywhere 
in the domain of $,, + $,, = 0, then the new transformed PDE in the new 
coordinates u,v will still be Laplace's equation (in the new coordinates u,v). 
That is, 6,, + b, = O is transformed into the equation $,, + $,, = 0. So, the 
idea is to find a conformal mapping that changes the original complicated bound- 
ary to a simple one (remember w = z? changed the boundary of the first quadrant 
of the z-plane to the real axis of the w-plane). 

We now present a few examples to show how conformal mappings can be 
used to solve PDEs. 


Laplace's Equation in the Upper-Half Plane 


Suppose we wish to solve the following Dirichlet problem in the upper-half plane 
(Figure 47.3): 


PDE 6,,+%,=0 -%<x<% O<y<wo 

(47.1) -— 
x| > 

BoP fue t |x| <1 


One way to solve this problem would be to apply the Fourier transform to the 
x-variable, but an easier method is to conformally map the upper-half plane y 
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$0  -1 $21 1 $20 


FIGURE 47.3 Boundary-value problem in the upper-half plane. 


> 0 to a new region of the uv-plane. With a little effort, the reader can see that 


the conformal mapping 
w = log 1 — 
= 95 zb 


has the following properties (see Figure 47.4): 


7 ex n M. 


x 


FIGURE 47.4 Conformal mapping of a hard problem into an easy one. 


1. It maps the upper half of the z-plane conformally onto the region — æ 
«uxo, 0«v« m of the w-plane. 
2. The line segment y = 0, —1 < x < 1in the z-plane (where the potential 
ó is one) maps onto the line v = m, ~œ < u < o in the w-plane. 
3. The two segments x > 1, y = 0 andx < -1,y = O in the z-plane map 
onto the positive and negative u-axis of the w-plane, respectively. 
The reader should make sure that he or she can verify these statements. The 
importance of these properties lies in the fact that the original problem (47.1) 
is now transformed into an easy one 


PDE Duu + 6,70 —-m~<y<o O<v<r 
(47.2) 
BC $(u,0) = 0 
$(um)-1 
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1 
which has the obvious solution ó(u,v) = z v. Hence, to find the solution of 


our original problem (47.1), we merely find the coordinate v in terms of x and 
y and substitute into d(u,v) = v/m. Doing this, we have 


w=u+iv 


II 
o 
go 
ree 
NIN 
+] 
— | = 
b 


li 
o 
gà 


and, hence, 


s 239] -— Xd dy 1 
s ele +] i 5Ixc1-iy 


B xX + y? — 1 +i2y 
LJ rrr 


[from the general rule arg (x + iy) = arctan (y/x) and we take that part of the arctan 
between O and ^r] 


The reader should check the graph of this function along various lines y = c to 
get an idea of what it looks like. 

For our second example, we transform a region between two nonconcentric 
circles into an annulus. 


Dirichlet Problem Between Two Nonconcentric Circles 


Suppose we wish to find the potential o(x,y) between the two circles 


x! +y =l 
x-1} +y=9 


where the potential on the inside circle is one and two on the outside circle 
(Figure 47.5). 
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ix - 1? +y? -9 


u? +v? - 6.86 


FIGURE 47.5 Conformal map onto an annulus. 


In other words, our original problem is 


PDE $6, + o, = 0 Inside D 


(x,y) 
xi bos 


(47.3) 
1 On x? + y? = 1 
2 On (x - 1)? +y = 9 


The problem now is to find a conformal mapping that will transform this domain 
into a nice easy one where our problem will be simple. In this case, it seems 
obvious to seek a transformation that maps our domain into an annulus. This 
is not a well-known transformation, but there are sources that will provide us 
with just the proper mapping. One of the more elaborate sources, The Dictionary 
of Conformal Mappings by H. Kober (Dover Publications), will provide the 
reader with hundreds of mappings between the common domains. Assuming 
that the reader is willing to spend a little time getting familar with the tables, 
he or she can find the desirable conformal transformation for the problem (47.3). 


In our specific case, it turns out to be the mapping 


Z E 
(47.4) w = 2t E = | 
where s = —0.146 and t = — 6.85. In the equivalent real form, it is 
(47.5) u-ylx-s(x-0- v] 
v-ybG - tj 


where 


y = 2t/[(x — t + y] 
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Under this conformal transformation, the original nonconcentric circles map 
onto the new circles u? + v? = 1 and u? + v? = 6.86 (the reader could check 
this). 

If we now apply this conformal maping to our original problem (47.3), we 
arrive at the new Dirichlet problem inside an annulus 


(47.6) PDE Duu + 6,70 In the new annulus 
d(uyv)=1 Onw+v=1 
ave iow =2 Onw + v = 6.68 


The answer to this problem 1s not difficult, since we can see that the solution 
will be radially symmetric and we know that all radially symmetric solutions to 
Laplace’s equation are of the form 


b(r) = alnr + b r=u+yv 
Substituting this equation in the BCs of (47.6), we get 
(u,v) = 0.57 In (u? + v) + 1 


and so if we substitute back to our original coordinates x and y by means of the 
transformation (47.5), the answer to problem (47.3) is (x,y) 


(x,y) = 0.57 In (u? + v?) + 1 


where u and v are given by equations (47.5). 


NOTES 


1. The Schwarz-Christoffel transformation is a procedure for constructing con- 
formal mappings from fairly general regions of the z-plane to the upper half 
of the w-plane (of course, once the problem is transformed into the upper- 
half plane, we could transform again into yet another region). This method 
is described in reference 1 of the recommended reading. 

2. The conformal-mapping method is somewhat restrictive because it applies 
only to Laplace's equation in two dimensions (although, with a little mod- 
ification, it can be applied to Poisson's equation). 


PROBLEMS 


1. Where is the mapping 


z-] 
freto Zz% 
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conformal? Convince yourself that it maps the upper-half z-plane onto the 
strip -% <u <%, 0 < v < m ofthe w-plane. 

2. What is the image of the first quadrant under the mapping w = z’? It might 
be helpful to write the complex numbers in polar form 


z = re® 
3. Solve the Dirichlet problem in the first quadrant 
PDE bd, t+o,=0 QO0«c«x«oo Q0cyco 


1 0cx«1 
$(x,0) at lsx< om 


BCs 


apl 0<y<1 


by means of the conformal mapping w = z?. See the following figure. 


g=1 1 $-0 
4. Solve the following mixed Dirichlet-Neumann problem inside a 45° wedge: 


PDE b, +6, + bu = 0 O<r<1 0<0<7/4 


o(r,0) = 0 
BCs b(r,7/4) = 1 
$,(1,0) = 0 


$,01,0) - 0 
(Insulated) 


Qr, 7/4) = 1 


$(r, 0) =0 
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HINT The complex function w = log z = log |z| + i arg (z) maps the ray 0 
= c, of the z-plane onto the line v = c, of the w-plane and the curve r = c, 
onto the line u = log c; (log, of course, always means natural logarithm). See 
the figure that follows. 


y 


w = log(z) 
———» 


OTHER READING 


1. Complex Variables and Applications, 3d ed. R. V. Churchill, J. W. Brown, and R. F. 
Verhey. McGraw-Hill, 1977. This book is one of the best and contains a good chapter 
on the subject of conformal mappings, which can be thought of as a part of complex 
variables, along with applications of PDE. 


2. Dictionary of Conformal Mappings by H. Kober. Dover, 1960. This paperback will 
provide the reader with a list of conformal mappings. 
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ANSWERS TO 
SELECTED PROBLEMS 


LESSON 1 


1. (a) Second order, linear, nonhomogeneous, parabolic, constant coefficient coeffi- 
cients, two independent variables. 

(b) Second order, linear, nonhomogeneous, parabolic, constant coefficient coeffi- 
cients, two independent variables. 

(c) Second order, linear, nonhomogeneous, hyperbolic, constant coefficient co- 
efficients, two independent variables. 

(d) Fourth order, nonlinear, two independent variables. 

Yes, if G — 0. 

ug = 0 implies u(z, y) = g(y). 

5. uzy = 0 implies u(z, y) = f(x) + g(y). 


~ 


LESSON 2 


1. u(x,t) approaches zero for all x as t — oo. Try u(x,t) = et sin (nzr). 


Ed == T) +2 


3. U(x) = ——— [sinh 8/o? x + sinh y B/a2 (1 — x)] 


sinh TE 2 


LESSON 3 


2. Heat flows into the rod at the right end at a constant rate while the left-hand side 
is kept at zero degrees (zero can stand for any temperature). Keeping the left 
hand of the rod at zero actually means it will be a heat sink. 

3. Both ends of the rod are insulated so the total heat energy inside the rod will 
eventually become distributed uniformly. 


LESSON 5 


1 1 
3. 1- - sim (rx) + 3 sin (372) + > sin (57x) +- | 


4 1 
4. u(z,t) = - [c "sin (ma) + serene (37x) +- ] 
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1 1 
5. u(x,t)-— e~ (2)*t gin (27x) + oe sin (472) + Popes sin (672) 
8 J -rto l /-(3m)?t o; 
6. u(z,t) = 73 \e sin (7x) + 97° sin (371) +- 
LESSON 6 
l. u(z,t) 2 z 4 e- (79) gin (nz) 
8 | -rto l -(3mt,. 
2. Arte 3 e sin (7x) + 57^ sin (3712) +- 


LESSON 7 


l. u(x,t) = ae~ U/2*t sin (2/2) + age G7/2*t sin (31/2) + 
1 
where @o,41 = 2 | z sin ((2n + 1)ra/2] dx 
0 


2. An =(nm/2)*, Xy(x) = sin (nrz/2) (n=1,3,5,:-:) 


1 441 2 
oo ees ses To g-(nm)'t 
3. u(z,t) 2^ 3 2. "i: cos (NTT) 
LESSON 8 
1. u(z,t) = te SEN) n jon [((2n — 1)zz| 


2 1 

2. u(z,t)=2-——e* = sin (rx) — qe sin (27x) +- ] 
T 

3. u(x,t) = e- (7 +) sin (zz) 


LESSON 9 


1 
2. u(z,t) = zi — gu sin (7x) + [1 — e Qt sin (272). 


p 
(27)? 
1 


4 
3. u(z,t) = [Sens 4 Lau — my sin (rz) 


4c 1 2 
+ — ` e ((2n+1)a]"t sin [(2n + 1)rz]. 
T 2n+1 
4. u(z,t) = rae — e^! sin (Aix) where A, is the smallest root of tan À = —A. 
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5. u(z,t) = xcost+ X T(t) sin nre 


n=l 


2 1 
where Talt) = (—1)"2 f eto) sin e dr 
"T Jo 


LESSON 10 


2 [?1 
3. umi =| "t — cosw)e~” ' sin (wr) dw 


LESSON 11 


1. f(x) = $ {sin (nx) + ; sin (37x) + = sin (57x) +- ] 


4 F(é)= TEE VIF = =| 
LESSON 12 

3. u(z,t) = aoe 
LESSON 13 


2. u(x,t) = e^ sinz 


3. u(x,t) =sint + ages 

«nene (Set 

LESSON 14 

MM 
n=l 

LESSON 15 


1. u(x,t) =e 'sin (x — 2t) 
2. u(z,t) = e®7”* sin (x) 
3.. umi = e- (5-20* 


4. u(z,t)= Aa mace VIN /+4DO 
+ 
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LESSON 16 


2. The wave initially looks like sin mz but vibrates to zero because of the friction 
term ut. 
4. u(z,t) = cett) + c5 ea (7t) 


LESSON 17 


3. u(z,t) = jl 077 jg ro 


4. u(z,t)= Flee” ~ e (t0) 


LESSON 20 

1. u(z,t)-—sin(rz/L)cos (rat/L) + ; sin (372/L) cos (31at/ L) 
2. u(z,t) = 3 sin (372/L) sin (3rat/ L) 

4. u(z,t) = sin (37z/L)[sin (3rot/L) + cos (3rot/L)] 


4h 4h 
5. u(z,t) = — sin mg cos mt — —— sin 3rr cos3mt 4- --- 
v? 9r? 


LESSON 21 
2. u(r,t)-sin(mz) E (r?t) + E sin (xt) 
3. u(z,t) = Y bn cos (n?v^t) sin (nz) 


n=l 


1 
b, = 2 | (1 — x”) sin (nrz) da 
0 


LESSON 22 


4. The velocity is 1 with respect to the time scale 7 = at. 
5. 6S a/v 


LESSON 23 
1. (a), (c), (d), and (e) are elliptic, (b) is hyperbolic. 


1 
3. f=y— 5% n-y-3r 
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4. Uen =0 
5. Uaa — UBB = 0 


LESSON 24 


LESSON 25 
1. u(x,t) = 1+ e^" cos (zz) + je on" cos (372) 


2.. ui) = Y B, sin (nz) 


n=! 


t 
Bait) eere | e(nma)*s p. (s) ds, F,,(s) is the sine transform of f(z,t) 
0 


4. All B,’s are zero except Bı = 1 and B3 = 1/2. 
6. u(z,t) = ` Bn (t) sin (nnz) where B,(t) is found from 
n=l 


B,(t) + (nm)? «(0 = | Ca Qro) e 


B4,(0-1, B4,(0-20 n=2,3,--- 


LESSON 26 


2.. ume Gill — cos (3rt)] sin (312) + sin (7x) cos (7t) 


3. ui + Uz is a solution for (a) and (c), not a solution for (b) and (d). 
4. In each of four subproblems let one of the four equations be nonhomogeneous, 
the others homogeneous. 


t 
5. Un(t) seto] el n)"s E (s) ds 
0 
6. Yes. 


LESSON 27 


]l. u(x,t) = cos(x — t) 
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3. u(z,y,t) = e-e-ot/O* * (y-bt/c)*]-dt/c 

4. u(z,t)-F(x- t)e-* 72 

3 u(z, t) = F (2x EL 2x — y)e-*v-7) 

LESSON 28 
1 

l. zo <0 has characteristics z = zo, Zo > O has characteristics t = -~ (z — zo) 
0 

l 3 
2. flu)= 3" 


3. u(r,t) = d(z — t)e* 
4. u(r,t)- -lr(t4 1) - ó(x — t) 


LESSON 29 
0 0 0 1 0 0 0 -1 0 
lL. A211 0 0 B—|0 O0 O0 C=] 0 0 -1 
f 0 ] f —¢? ] L 0 “| 


3. ui(z,t) = d(x —3t) + v(z 4 t) 
uo(x,t) = 2à(x — 3t) — 2v (x + t) 


LESSON 30 
3. u(r,t) = 9, AmJo(Konr) cos (komt) 
9 1 
Am = Fm | r(1 Se r?) Jo(Kom?) dr 


4. u(r, t) = Jo(2.4r) cos (2.4t) 


it 
5. u(r,t) = Jo(2.4r) cos (2.4t) — z J0(8.65r).cos (8.65t) 


4; Jo(14.997) cos (14.932) 
LESSON 31 
l. wit = a? ur ES - ue 
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du ldu 
. — +-— = = Bl 
3 T3274 0, u(r)—- A- Blnr 
B 
4 u(r) = A+ — 


5. Since Uss +Uyy = 0 at each point (x, y) the height of the surface u(x, y) = zy is 
approximately equal to the average of the values on a small circle around (z, y). 


LESSON 32 


l. vw(r,0)-—rsin0 (good guess) 
2. No, the net flux is not zero. 
4. d'u/dz? +u = 0, u(0) = u(1) 2 0 


LESSON 33 


2. (a) u(r,OQ) =1+rsiné+ = 0086 


(b) u(r,0) = 
(c) u(r, 0) = ring 
(d) u(r, @) = r? sin (36) 


3. u(r0)-— ; sind 
" 
4. u(r,j0)— 73 sin (20) 
r 2f1 r? r^ 
5. u(r,0) = 58 sin + — fi- 3 cos20 — T cos40 — T= cos68 —---| 
7R 
j 16 P? 
LESSON 34 


r 4 2r - 
l. u(r) = {5 +g beste o Z baino 
2. (a) u(r,0)=1 


(b u(r0)21—4 am cos (30) 
(c) u(r,0) = - - sin ie — cos (30) 
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(d) u(r,0) — 5+ 2 fl sin (6) + grs sin (30) + = sin (50) +-+} 


3. ulr, 0) = — sing 
LESSON 35 


4. u(r,¢) = r^ Ps(cos $) — Tp (cos ġ) 


= z^ cos? ¢ — 3 cos ¢] — zr cos $ 


5. u(rQ)-— ` anr” Pa (cos $) 


n=0 


2n 41 [7^ 2n t 1 
On = —; / P,,(cos $) sin $ dọ — f r P,, (cos Q) sin $ dọ 


6. u(r,09)—- E4 = cos 


LESSON 36 


-— 

l u(r) = * 
] R 

2. G(z, y, £, n) = on In s] 


3. w(z,y)- zl |. n |Z | dan 


E RoR 
4. G(z,y,€&,n) = 5, In E 


5. uļlr,0)= S(r — 1)+rsinð 


LESSON 37 
1 h? 
3. Ui = g lucet + Ui—1,5 Ui + Uijl — 4 Fis 
—] 
4 uj = 30 — 3j eet + Ui,j-1 + Uit j + uii] 
LESSON 38 


2. u(x,t) = e^" sin (zz) 


396 Answers to Selected Problems 


LESSON 39 


2: Uii = 0, ^ + Uin = gi 

LESSON 40 

2. Solve for a and b from the equations wee) = 0 and cS) = 0. 
Oa Ob 

LESSON 41 


1. (a) Parabolic, canonical, (b) hyperbolic, not canonical, (c) elliptic, not canonical, 
(d) parabolic, canonical. 
2. 16Un, +u= 2 


1+2 
3. Uge + Unn + E Un = e 


LESSON 44 


l. g(z)2-x 
2. my+ky=0 


LESSON 45 


l. sul = f f ed uj + 2u de dy 
2. ia- [Mz] atm] 


LESSON 47 


1. Conformal except at z = +1. 
2. The first three quadrants. 


1 E Ary 
s Aan pm [msi] 
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APPENDIX 4 


Integral Transform Tables 


Table A: Exponential Fourier transform 
Table B: Fourier sine transform 
Table C: Fourier cosine transform 


Table D: Finite Fourier sine transform 
Table E: Finite Fourier cosine transform 
Table F: Laplace transform 


Definitions of Functions in Tables 


5(x) = delta function 


H(x — a) = h pls Heaviside function 


Reflected Heaviside function 


H(a — x) = b 


TABLEA Exponential Fourier Transform 


fx) = FF = ee Flue do Fla) = FI) = Dm fec 


1l. f'(x) iwF(w) 

2. f'(x) — w?F(w) 

3. f(x) (nth derivative) (io)" F(w) 
l,.[o 

4. flax) a>0 ;F (s) 
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TABLE A (cont. 


f(x) = 9-(F] = Jm f — F(u)e* do 


5. 


10. 
11. 


12. 


13. 
14. 
15. 
16. 


17. 


fœ — a) 


e ^" 


Ix] «a 
0 kl|>a 


Ix] «1 
0 |x|>1 


d(x — a) 


fíx)*gx) 


(1 + x2)" 


xe al a>0 


H(x + a) - H(x —- a) 


NM m 
x" d 
2ax 
(x? + a’) 
cos (ax) |x| < m/2a 
0 Ix| > /2a 
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Flo) = if) = a |. fene as 


1 
az Feo) 


LUE 
i 


EP 2 law 
T (o + a’)? 
2 sin (aw) 
T w 
i e^ 
—i fe 
2 
2 a 
IE PPE (1/2a) 


TABLE A  (cont.) 


f(x) = F-'[F] = z f | Flew" do 


1-l| fxl <1 
18. 

0 k| > 1 
19. cos (ax) 
20. sin (ax) 


TABLEB Fourier Sine Transform 


fx) = | "Fey Sinn du 


0cx«o 

l. f'(x) 
2. f(ax) 
je g 
4. x" 
5. H(a - x) 
6. x^! 

x 
5 xcd 


Flo) = Ff] = cum | fede de 


; f [s em] 
T7 Qo 
iE [5(o + a) + (w — a)] 


3E [$(o + a) — 8(w — a)] 


Fijos Z f Kosmala 


0coco 


i 2 
— 9? F(w) + ~of(0) 


i) 
a a 


2w 
mha + w?) 


i 


E [1 — cos (wa)] 


1 
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TABLEB Fourier Sine Transform 


fe) = [7 Flw) sin (wx) do Fw) = 2 [7 fa) sin (wx) ax 
0cx«o 0<w<n 
X cC eu i 
8 y+ 4 2€ sin o 
9. tan-'- Hi x 
X wW 
10. -x ip 
x?f(x) z (w) 
ll. erfc(x/2 Va) 2 [ Her | -— 
TABLE C Fourier Cosine Transform 
s 3 [* 
f(x) = | F(w) cos (wx) do F(w) = - | f(x) cos (wx) dx 
0cx«o 0< w<% 
Py, 
1. f"(x) -wF(e) - 7f (0) 
1 
2. flax) zF(ola) 
me 2a 
or ma? + w?) 
2 
4 5(x) T 
Se uc E 
TWH 
6. H 2 
i (a — x) ~ Sin (aw) 
7 -ax2 1 (= w/a) 
" e Vna. 
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TABLE C Fourier Cosine Transform 


fix) = | “Fay eos (ux) dis F(w) = : | ECC ICT. 
0cxc«o 0coc»o 
8. Sin en H(a — w) 
a — aw 
2 r+ @ ý 
2 
10. -xV(x) MO, 


TABLED Finite Sine Transform 


The finite sine transform transforms a function f(x), 0 < x < « into a sequence S,, 
n= 1,2,...by means of the formula 


ES Z | "Glo (n) di 


It is convenient, insofar as tables are concerned, for the range of the variable x to lie in 
the interval [0,7]. The reader can transform any other interval [a,b] into [0,7] via the 
transformation 


TT 
pops cud) 


There is nothing mysterious about the finite sine transform; the members of the sequence 
$, are the coefficients of sin (nx) in the Fourier sine series of f(x). That is, 


f(x) = > $, sin (nx) 


fo) = > S, sin (nx) se Z | ” f(x) sin (nx) dx 
O<x<=T7 n=1,2,... 
L f'G) = eS, + = ((0) - (- f] 
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TABLED (cont) 


fix) = È S, sin (nx) s, = 2 [" fæ) sin (nx) dx 
n=l ) 
Osx<xT7 n=1,2,... 
1 n=m 
2. sin (mx) m= k 2 3; es I nm 
3. y a, sin (nx) a, 
n=1 
2 
4 m-x — 
n 
2 n+1 
5. x ;UD 
2 
6. 1 mU — (-1y] 
7. b : i "cos (na) 0-cacm 
i ees 
(Tm-ax xsa 2. < 
8. [s -xja x»a „sin (na) 0cacm 
T n ngan 
9, 2€. n? 4 a? [1 ( 1) e ] 
jo, Sba — x) — 2n 
i sinh at a(n? + a?) 


TABLE E Finite Cosine Transform 


The finite cosine transform transforms a function f(x), 0 < x < «m into a sequence C,, 
n —0,1,2,... by means of the formula 


C, = £ | f(x) cos (nx) dx 


It is convenient, insofar as the tables are concerned, for the range of the variable x to 
lie in the interval [0,7]. The reader can transform any other interval [a,b] into [0,7] via 
the transformation 

T 


gus ue) 
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There is nothing mysterious about the finite cosine transform; the members of the se-- 
quence C, are the coefficients of cos (nx) in the Fourier cosine series of f(x). That is, 


f(x) = ce + y C, cos (nx) 


C = 7 
f(x) = > + 2, C, cos (nx) E 2f f(x) cos (nx) dx 
O<x<T7 a 
n T 2 2 
L f'Q) -mC, - Z(f'(0) - (-1f'()) 
2. 2 + Y a, cos (nx) d, 
n=1 
2 
3. fm- x) (CIE G 
T 
2n=0 
a {3 n= 1,2, 
5. cos(mx) m= 1,2 n mum 
EE 0 ny*m 
T n -0 
6. x 2 , » 
za (=) e. n = 1,2, 
27/3 n=0 
7 2 4 
* SP und 
A 0 n=0 
8. -log (2 sin x/2) p -— 


9 las 2 (—1)"e77 ade 1 
a T n? + @ 
2 Oise n=0 
10 1 0O<x<a LE 
s —1 a«cx«m 4 
— sin (na) n = 1,2, 
na 
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TABLEF Laplace Transforms 


10. 


11. 


12. 


13. 


14. 


15. 


16. 


f(t) = L£-'[F(s)] 


1 


e” 


sin at 


cos at 


sinh at 


cosh at 


e“ sin bt 


e“ cos bt 


t" n = positive integer 


("e 


H(t — a) 


H(t — af (t — a) 
e"f(t) 
fKt)*g(t) 


f'(t) ^ (nth derivative) 


flat) 
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F(s) = £[f()] 


1 
= s>0 
S 

1 
S-—a A 

a 
x $260 

S 
S +a pee 

a 
s2 = a? $ > lal 

S 
s2 E a? S > la| 
M m 
(s — ay «b? 
TS Uu, MN 
(s — ay +b? 

! 
ii s>0 
gn*! 

n! 
(ge $79 
e 7 

520 

S 
e "F(s) 
F(s — a) 
F(s)G(s) 


s*F(s) — sU) — . 


a a 


o. fe^ (0) 


TABLE F Laplace Transforms 


17. 


18. 


19. 


20. 


21. 


22. 


23. 


f(t) = £°'[F(s)] 
[f d: 
erf(ti2a) 
erfc(al2N/t) 
J,(at) 

d(t — a) 
Uu t3 


Im — ae” erfc(aVt) 


F(s) = EKo] 
: F(s) 

1 1242 

ae erfc(as) 
l,-avs 

5 


(s? + ay? 
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APPENDIX 2 


PDE Crossword inani 


S ite GSES SSS RS BEN 

NNMNSSNSSSSSBSSSSBSSBSSSSSNN 

ASSES SSN GS OBEN NEM. 
AS 


E TURENNE BS OBSS E 
CNS NG LENS SSSI 
BEBE SN S SSSESNSNSSS TTT TN 
ESES SEN RGSS 
CNTNNY SSG ISSGQ WWE 
TET LLL ETT SESSSSSSSSSSSSSE SS 
NNENBNSENSBSENSBS ETS 
NNN NTN NNN WG GGT 
NSNSNSENSBEEBSNSESBS S S S SEES 
N yyw ANN 
BSESBSBSES O NE o 
BSNSBSBSBSBSS ESNSSSSSBSNS 
NES SRSNRERERS  SRRRRRERER 
NN WEG WYNN GGG WY 
E RN TEENA 
BSSSENSNSSSBNNSBSBSSSSSBSBN 
NSESNSSBSSBS NS EEBEERET T 
E E WA EEN SSS 
PNAS NVR ELLEN 
SEEBEESES S S SN SS SS 
PAREN RSS SSSSSEISSISQS 
NNN: N NNS: EET TET EN TET 


Across 


1. 


A PDE of the form A(x,y)u,, + B(x,y)u,, = f(x,y) is called an 


equation. 
3. A person’s name associated with a method for solving initial- 


boundary-value problems with difficult BCs in terms of solutions 


of problems with simple BCs. 
5. Types of equations where the principle of superposition holds. 
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The author of a famous text on PDE. 
In order for separation of variables to work, the PDE must be 


A first-order equation of the form u, + f, = 0 is called a 
equation. 

When we solve Laplace's equation in polar coordinates by sepa- 
ration of variables, the ODE in r is named after this man. 


The equation 4, = u,, is commonly called the 

equation. 

The equation u,, + u, + u, - 0isa____________ differential 
equation. 


A useful way to solve the equation u, = Du,, — vu, is by ____ 
coordinates. 


The equation u, = u,, is commonly called the 

equation. 

The Crank-Nicolson method isan... . .— |.  . method. 
The... of a BVP quite often are proportional to 


the natural frequencies of the problem. 

When solving Laplace's equation in spherical coordinates by sep- 
aration of variables, the ODE in 6 is called 

equation. 

The potential due to a point charge is called 

function. 

The most basic idea behind the solution to linear problems is 


A method of minimizing functionals by replacing the functions by 
polynomials is due to 

If the dependent variable is found explicitly as a function of the 
independent variables of the problem, we have an 

solution. 

A famous mathematician/physicist responsible for the discovery of 
calculus and some differential equations. 

The quantity that measures the difference between a function at 
a point and its surrounding points. 

The basic vibrations of a membrane are called the 

solutions. 


An integral transform in which the kernel is a Bessel function. 
PDE can be simplified by changing the variables of the problem 
to. ~ ~ variables. 

A famous mathematician who died at the age of 27 and had nothing 
to do with PDEs. 

Initial-boundary-value problems defined on bounded domains can 
be solved by... |.  J  Á Á  Á . integral transforms. 
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8. The PDE PR" + rR' — XR = 0 is called 


equation. 

9. Waves of the form [cos (nmt) sin (nvx)] are called 
waves. 

11. A numerical method in which the time increment must be kept 
small. 


15. The ODE in r we must solve when solving the vibrating circular 
membrane is due to SS 

17. The BVP of the second kind is called the 
problem. 

18. The u, term in the equation u, = Du,, — vu, is related to the 

of the material. 

20. Responsible for a very elegant solution of the one-dimensional 
wave equation in free space. 

23. A transform that changes derivatives to multiplication is called an 


LLL transformation. 
25. The equation e*u,, + u,, = 0 is a PDE of the 
type. 
26. The PDE u, = u, is called the. . | equation. 
29. If the solutions of a PDE are standing waves, then we might call 
the PDE a _____________ equation. 
30. The PDE u, + u, = f(x,y) is named after _______.__. 
31. The Legendre polynomials {P,(x)} are —— — — —— — on 


the interval [0,1]. 

32. Most nonlinear PDEs must be solved by 
methods. 

34. An integral transform that we generally use on the time variable 
is due to ___ 

36. The PDE problem with only IC is called a 
problem. 

37. A BVP in which the BC relates the flux to the solution at the 
boundary is called a BVP of the ______ kind. 

39. The normal derivative at the boundary of a region is related to the 
__________ of material across the boundary. 

40. The director of the Courant Institute of Mathematical Sciences is 
Professor 
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APPENDIX $ 


Laplacian in Different Coordinate 
oystems 


PPP 
V*u = Ux + 


V^u = u, + 


V?u = uy + 


u Two dimensional cartesian Laplacian 


yy 


1 u, + l gg Two dimensional polar Laplacian 
7 


re 


Uy, + Uz, Three dimensional cartesian Laplacian 


LI u, + 2 Ugg + Ug Three dimensional cylindrical Laplacian 
r 


r 


Three dimensional 
spherical Laplacian 


Cartesian coordinate Cylindrical coordinate Spherical coordinate 
system system system 
r20 r20 
0x0 «2n 0sz0-«2m 
-x <z «« 0<o5 7 
x = rcos8 x = rsingdcos 0 
y = rsin0 y = rsin $sin0 
2€ 2 z= rcosó 
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Types of Partial Differential 
Equations 


U, 
u, 
u, 


H, 


412 


+ 


Elliptic Partial Differential Equations 


0 Laplace’s equation 
Xu = 0  Helmholtz’s equation 
k Poisson’s equation 


kE — Vju = 0 Schrödinger’s equation 


Hyperbolic Partial Differential Equations 
Cu One dimensional vibrating string 


Cu, — hu, Vibrating string with friction 

Cu, — hu, — ku Transmission line equation 

Cu, + fGx,t) Wave equation with forced vibrations 
c? V2u Wave equation in higher dimensions 


c? V^u — hu, Wave equation with friction 


Parabolic Partial Differential Equations 
o? Uyy One-dimensional diffusion equation 


A? ux — hu, Diffusion-convection equation 
au, — ku Diffusion with lateral heat-concentration loss 


au, + flx,t) Diffusion with heat source (or loss) 


Appendix 4 


Index 


Analytical solution, 324 
Annulus, Dirichlet problem, 270 


Beam problem, 161 
Bessel’s equation, 234 
Bessel’s functions, 235 
Boundary conditions: Dirichlet (first kind), 
14, 146, 255 
Neumann (second kind), 20, 146, 256 
Robin (third kind), 23, 146, 258 
Brachistocrone problem, 353 


Calculus of variations, 353 
Canonical coordinates, 135 
Canonical form of PDEs: elliptic, 174, 331 

hyperbolic, 174 

parabolic, 174, 331 
Cauchy problem, 93 
Characteristic curves, 138, 144, 178, 205 
Characteristic equations, 177 
Classification of PDEs, 174, 331 
Complementary error function, 79, 103 
Conformal mapping, 382 
Conservation equation, 29, 213 
Convection, 61, 112 
Convection-diffusion equation, 112 
Convolution: finite, 100 

infinite, 91 

Crank-Nicolson method, 317 
Crossword puzzle, 398 


D’Alembert solution, 129 
Delta function, 293 
Descent, method of, 188 
Diffusion, 112 
Diffusion-convection equation, 112 
Diffusion equation, 13 
Diffusivity, 25 
Dimensionless variable, 168 
Dirichlet's theorem, 83 
Drumhead, vibrating, 232 
Duhamel’s principle, 106 


Eigenfunction expansion, 64 
Eigenvalues, 52, 225 


Eigenvectors, 66, 225 
Elliptic equation, 6, 174 
Error function, 79, 103 
Euler's equation, 272 

Euler's formulas, 82 
Euler-Lagrange equation, 356 
Exterior BVPs, 276 


Fermat's principle, 359 


Finite difference methods: explicit, 309 


implicit, 317 
Finite differences, 301 
Finite transforms, 72 
First order PDEs, 205 
Flux, 21, 113 
Fourier coefficients, 82 
Fourier cosine transform, 73 
Fourier series, 81 
Fourier sine transform, 73 
Fourier transform, 81 
Free space wave equation, 183 
Functionals, 353 


Fundamental solutions, 37, 163, 237 


Green's function, 94, 290 


Harmonics, 82,158 

Heat equation: derivation, 27 
Heaviside equation, 114 
Helmholtz equation, 233 
Huygen's principle, 183 
Hyperbolic equations, 6, 123 


Impulse-response function, 94, 290 


Initial-boundary value problem, 14, 24 


Initial value problem, 93, 115 
Integral transforms: cosine, 73 
finite cosine, 73, 191 
finite sine, 73, 191 
Hankel, 74, 104 
Laplace, 74, 97, 106 
sine, 73 
Interior Dirichlet problem, 262 


Kernel of integral transform, 72 
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Laplace's equation: in an annulus, 270 
definition, 246 
in a disc, 232 
in a square, 303 
in three dimensions, 280 
Laplacian, 245 
Legendre's equation, 284 
- Legendre's polynomial, 284 
Liebmann's method, 304 
Logarithmic potential, 278 


Matrix algebra, review, 225 
Method of characteristics, 205 
Minimum energy method, 363 
Monte Carlo methods, 340 
Moving coordinates, 112 


Newtonian potential, 282 

Newton's law of cooling, 21 
Nonhomogeneous BCs, 43 
Nonhomogeneous PDEs, 6, 199, 290 
Nonlinear PDEs, 213 


Numerical methods: elliptic equation, 301 


explicit, 318 
implicit, 318 
parabolic equation, 310, 318 


Orthogonality, 38, 82 


Parabolic equation, 6 
Parameter identification, 326 
Perturbation methods, 370 
Point sources and sinks, 291 
Poisson's equation, 290 
Poisson's formula for free space, 186 
Poisson's integral formula, 262, 265, 296 
Potential: logarithmic, 278 

Newtonian, 282 


Random numbers, 342 
Reflection of waves, 143 
Ritz, method of, 362 
Rodrigues’ formula, 284 


Schwarz-Christoffel transformation, 386 


Separation of variables, 33, 49, 155 
Shock waves, 213, 219 


414 index 


Specific heat, 30 

Spectrum of a function, 75, 83, 85 
Spherical harmonics, 280 
Standing waves, 153, 237 

Steady state solution, 68, 254 
Stokes theorem, 185 
Sturm-Liouville problem, 56 
Superposition, 95, 198 

Systems of PDEs, 223 


Tables of integral transforms, 389 
Telephone equation, 125 
Thermal capacity, 29 

Thermal conductivity, 22, 30 
Tour du wino, 346 

Traffic flow, 217 


Transformations: of boundary conditions, 


43 
of dependent variables, 169 
of hard problems to easy ones, 58 
of independent variables, 70 
Transient solution, 45, 68 
Transmission line equation, 126 
Travelling waves, 134, 139 


Undetermined coefficients, 70 


Vibrating beam, 161 
Vibrating drumhead, 232 
Vibrating string, 123 
Vibrations: longitudinal, 125, 148 
torsional, 125, 148 
transverse, 123, 148 


Wave equation: derivation, 123 
in free space, 183 
one dimensional, 123, 129 
three dimensional, 184, 247 
Waves: cylindrical, 183 
free space, 183 
moving, 112 
plane, 183 
spherical, 183 
standing, 153 
travelling, 134, 139 


Young's modulus, 149 


